-- Logs begin at Wed 2022-08-24 16:52:50 UTC, end at Wed 2022-08-24 18:03:07 UTC. -- Aug 24 17:23:58.388092 dv-cinder-835384-24-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 17:23:58.395572 dv-cinder-835384-24-smb devstack@keystone.service[81762]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:23:58 2022] *** Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: nodename: dv-cinder-835384-24-smb Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: machine: x86_64 Aug 24 17:23:58.397575 dv-cinder-835384-24-smb devstack@keystone.service[81762]: clock source: unix Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: pcre jit disabled Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: detected number of CPU cores: 4 Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: current working directory: / Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: your processes number limit is 47680 Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: your memory page size is 4096 bytes Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: detected max file descriptor number: 2048 Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: lock engine: pthread robust mutexes Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: thunder lock: enabled Aug 24 17:23:58.397965 dv-cinder-835384-24-smb devstack@keystone.service[81762]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 17:23:58.398571 dv-cinder-835384-24-smb devstack@keystone.service[81762]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:23:58.438803 dv-cinder-835384-24-smb devstack@keystone.service[81762]: Python main interpreter initialized at 0x55a8aa6979c0 Aug 24 17:23:58.438803 dv-cinder-835384-24-smb devstack@keystone.service[81762]: python threads support enabled Aug 24 17:23:58.438803 dv-cinder-835384-24-smb devstack@keystone.service[81762]: your server socket listen backlog is limited to 100 connections Aug 24 17:23:58.438803 dv-cinder-835384-24-smb devstack@keystone.service[81762]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:23:58.439238 dv-cinder-835384-24-smb devstack@keystone.service[81762]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:23:58.439317 dv-cinder-835384-24-smb devstack@keystone.service[81762]: *** Operational MODE: preforking *** Aug 24 17:23:58.439567 dv-cinder-835384-24-smb devstack@keystone.service[81762]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:23:58.439567 dv-cinder-835384-24-smb devstack@keystone.service[81762]: spawned uWSGI master process (pid: 81762) Aug 24 17:23:58.439779 dv-cinder-835384-24-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 17:23:58.440910 dv-cinder-835384-24-smb devstack@keystone.service[81762]: spawned uWSGI worker 1 (pid: 81775, cores: 1) Aug 24 17:23:58.440910 dv-cinder-835384-24-smb devstack@keystone.service[81762]: spawned uWSGI worker 2 (pid: 81776, cores: 1) Aug 24 17:23:58.440910 dv-cinder-835384-24-smb devstack@keystone.service[81762]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:24:02.802951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:02.802951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Aug 24 17:24:02.803738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:02.803738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Aug 24 17:24:02.804456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:02.804456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Aug 24 17:24:02.804898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:02.804898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Aug 24 17:24:02.855151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:24:02.855151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:24:02.855151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] command line args: [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:24:02.855472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:24:02.855554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:24:02.855634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ================================================================================ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:24:02.855716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:24:02.855809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.855887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] command line args: [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:24:02.856036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_dir = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:24:02.856263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ================================================================================ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:24:02.856424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_source = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] debug = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_dir = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.856834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_source = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] debug = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.857962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_config_append = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_dir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_config_append = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.858953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_dir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.859986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.860856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.861902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] publish_errors = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.862963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] publish_errors = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.863956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] standard_threads = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] standard_threads = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.864893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_journal = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_json = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_stderr = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_syslog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_journal = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_json = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.865869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.865994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_stderr = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.866091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_syslog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.866172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.866321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:24:02.866402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.866577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.866652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.866825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.866899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.867916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.868879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.869832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.870988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.871983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.872982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.873944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.874812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.875467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.875600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.875776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.875853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.876912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.877977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.878849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.879002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.883827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.883952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.884968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.885985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.886966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.887996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.888974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.889986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.890481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.891946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.external = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.external = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.892957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.password = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.password = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.token = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.token = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.893985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.894954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.895956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.896940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.897959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.898930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.899974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.900905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.901907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.902881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.903870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.904972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.905955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.906956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.907992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.908887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.909898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.910853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.911943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.912914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.913955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.914967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.915988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.916942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.917913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.918956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.919931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.920911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.921935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.922956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.923034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.925947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.926982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.927940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.928985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.929897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.930915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.931995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.932974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.933936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.934871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.935869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.936996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.937140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.937218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.937280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.938871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.939865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.940985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.941942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.942976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.943155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.943235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.943327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:24:02.943405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.943630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.943875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.944114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:24:02.944290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:24:02.973822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.974044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.974268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.974355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.974574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.974800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.982841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:02.990232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.019771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.019999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.020088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.020235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.083400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.083792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.138110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.138110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.138392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.138392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.296310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.296500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.296579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.296644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.297926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.298025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.298302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.326904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.327955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.328115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.328203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.328371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.328504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.328584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.339824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.340088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.353986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.354986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 17:24:03.377720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.377926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 17:24:03.378163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.378299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.378416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 17:24:03.378518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 17:24:03.378746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.378828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.378952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 17:24:03.379032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.379252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.379519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.379600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.379798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.380035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.380307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.395796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.395796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.395796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.395995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.396066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.396139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.396139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.396139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.396965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.397839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.399868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.400158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.400446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.400736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.400817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.401026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.401934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.402797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.403044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.403346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.403620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.426121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.427279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.427605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.427894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.428732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.429020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.432549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.432841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.433129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.433654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.433939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.434222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.440220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.440512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.441462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.441753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.444607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.444903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.445194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.445485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.445770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.445930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.447234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.447908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.463817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.464109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.465591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.465874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.467974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.470175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.471350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.471687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.473468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.473775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.475874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.477983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.478975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.481151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.482208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.482513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.482806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.483128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.483429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.483733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.485038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.485471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.485763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.486059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.486347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.486648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.500621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.500915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.504587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.504587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.504872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.504872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.504872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.504872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.508308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.509831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.510109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.510996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.512530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.512776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.512860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.513066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.513362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.513660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.513944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.515528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.515995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.516376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.516672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.516953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.525279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.525565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.533761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.534140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.542669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.545729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.546285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.549185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.550336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.550622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.552122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.552412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.552713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.553261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.554702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.556252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.556534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.556830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.563253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.563253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.563814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.563898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.564150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.564444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.564733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.565276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.568194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.568487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.568785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.569074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.572766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.573067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.573358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.577303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.577597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.577877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.580528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.580819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.581107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.581389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.581669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.581957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.582247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.582572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.582798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.583091 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.583381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.583649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.583941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.584198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.585150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 17:24:03.585438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.585723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.586000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.586274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.586542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.586815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.587119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.587395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.587665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.587949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.588223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.588505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.588768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 17:24:03.619129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8aa6979c0 pid: 81775 (default app) Aug 24 17:24:03.622574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab763-0890-4b92-abff-621659ca09fe None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:03.622861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab763-0890-4b92-abff-621659ca09fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:03.623157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab763-0890-4b92-abff-621659ca09fe None None] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:03.624542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8aa6979c0 pid: 81776 (default app) Aug 24 17:24:03.627492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Aug 24 17:24:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:11.166692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:11.167228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:11.167307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:11.172163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:11.179176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:11.179639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:11.179723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:11.251423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: INFO dbcounter [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] Registered counter for database keystone Aug 24 17:24:11.270870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG oslo_db.sqlalchemy.engines [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:24:11.277091 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writer thread running {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:24:11.461368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81775) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 17:24:11.461708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81775) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 17:24:11.517688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:11.519356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:11.650729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 17:24:12.112119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:12.181915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: INFO dbcounter [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] Registered counter for database keystone Aug 24 17:24:12.204470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG oslo_db.sqlalchemy.engines [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:24:12.210666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writer thread running {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:24:12.334687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112d5c-0546-4995-a46b-2042a74b08a9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:12.338994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:12.339652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:12.339938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:12.340222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:12.348491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:12.399964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 17:24:12.400253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b589-2031-4a9f-ad69-259aae60cde1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:12.410166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 17:24:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:12.416132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:12.431237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cbfe-9ca1-43c6-9311-82631e13ebf2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:12.435694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:12.436797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:12.437707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:12.437983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] PATH_INFO: `/v3/projects/8605dc2974624582acfcd7c33837d42e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:12.439614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] RBAC: Authorizing `identity:get_project(project_id=8605dc2974624582acfcd7c33837d42e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:12.491913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 17:24:12.492259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2093fa-be2e-4ee4-8ad8-6c77f6a95b94 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:12.496936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Aug 24 17:24:12 2022] GET /identity/v3/projects/8605dc2974624582acfcd7c33837d42e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:14.373829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351597-b8e1-4ff7-9e12-98b7793b0d25 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:14.374369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351597-b8e1-4ff7-9e12-98b7793b0d25 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:14.374369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351597-b8e1-4ff7-9e12-98b7793b0d25 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:14.379044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:24:14.384824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:14.385209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:14.385379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:14.405977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:14.407579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:14.415402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 17:24:14.683626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351597-b8e1-4ff7-9e12-98b7793b0d25 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:14.696544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351597-b8e1-4ff7-9e12-98b7793b0d25 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:14.701009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:14.701612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:14.701892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:14.702166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:14.710157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:14.711977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9262-e9c9-4e33-8627-5e1e79a45495 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:14.721048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 17:24:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:14.726701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:14.736499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262140-d2c2-4bc5-9be3-e30225b552ce None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:14.740909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:14.741540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:14.741823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:14.742102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:14.743449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:14.745300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97335b8e-9eec-4322-a077-08ba0f5135a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:14.746842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Aug 24 17:24:14 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:16.763751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955fab-b2f4-4b3b-aa37-808ecb0cd98b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:16.764333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955fab-b2f4-4b3b-aa37-808ecb0cd98b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:16.764663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955fab-b2f4-4b3b-aa37-808ecb0cd98b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:16.767472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:16.774347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:16.774838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:16.774930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:16.784412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b202f5e-ae0b-48be-b414-e57bd6d7d5f1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:16.784706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b202f5e-ae0b-48be-b414-e57bd6d7d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:16.784991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b202f5e-ae0b-48be-b414-e57bd6d7d5f1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:16.786333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:24:16.794876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:16.796110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:16.798921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:16.799246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:16.799532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:16.845179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81776) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 17:24:16.845508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81776) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 17:24:16.892002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:16.893641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:16.907239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:16.993548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:17.178420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.204036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.257743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.288060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9806-c537-4200-9576-5a5c541ebceb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.322771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.323695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.323990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.324269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.336434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:17.345943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:17.346936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:17.348524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:17.353301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.365754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7d10-d8c3-4001-a108-c6fd9d3e8d9f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.368198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.404691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.405610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.405905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.406199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.441475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.459819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304c996-b470-4563-a2d0-e0d7a839ecd4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.475831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.477381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.496471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.497083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.497362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.497639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.498303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:17.498607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.500598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.512889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:17.518604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.583996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 17:24:17.589163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.592265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.621735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ff91e-99e3-4842-8ec3-648cd457859d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.657672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.658313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.658595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.658872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.660076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.661548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.663166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:17.668819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.685532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.690086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b940dc-19ab-48ac-8441-89effee709c1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.725832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.726622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.726910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.727224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.745938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.747461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:24:17.766200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:17.767657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:24:17.768448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:24:17.768448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:24:17.768448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:17.768448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:17.773572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.774048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678bf9-2488-479d-bef0-d1d40490b766 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.809210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.809875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.810111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.810383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.811529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.813492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.815040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:17.820775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:17.833232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.878181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978b90-3bf3-467a-8bf3-dd1e29d4668c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.904578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:17.913894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.916472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.916472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.916472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.916472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:17.916472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.917403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcb49-6445-46e9-9b48-d2a01a0e07ee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.925625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1449-0beb-43ed-a931-14693a80c042 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:17.945040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:17.971584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:17.972226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:17.972511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:17.972787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:17.973538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.domain.id=default, user.id=9e6b9970f28a4f428fe5a1ef6b19deeb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:17.973848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:17.975365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23f67-0ad0-4543-aa5e-c1da73d6caa3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:17.983322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 17:24:17 2022] GET /identity/v3/role_assignments?user.id=9e6b9970f28a4f428fe5a1ef6b19deeb&scope.domain.id=default&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:20.203808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b55e-c207-4d4a-a794-4b072a9b0349 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.204872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b55e-c207-4d4a-a794-4b072a9b0349 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.205373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b55e-c207-4d4a-a794-4b072a9b0349 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.207592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:20.212946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83682-2d99-4bec-977e-3c34dec20573 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.213445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83682-2d99-4bec-977e-3c34dec20573 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.213527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83682-2d99-4bec-977e-3c34dec20573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.238824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-32a83682-2d99-4bec-977e-3c34dec20573 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:20.240114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32a83682-2d99-4bec-977e-3c34dec20573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:20.302701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8baa-b11a-4b3b-b8ff-5a918f0e0962 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.303018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8baa-b11a-4b3b-b8ff-5a918f0e0962 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.303317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8baa-b11a-4b3b-b8ff-5a918f0e0962 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.304874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 12/23] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:24:20.317675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.317955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.318233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.346222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 12/24] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:20.355271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:20.356491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:20.396656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb651c-5365-4718-9d67-55b3d8c71ffc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.396957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb651c-5365-4718-9d67-55b3d8c71ffc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.397225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb651c-5365-4718-9d67-55b3d8c71ffc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.398595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 13/25] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:20.404415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.404705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.405086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.457492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:20.458611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:20.502681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 13/26] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:20.584694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:20.784431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:20.846148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:20.926893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125512e-ca0a-457a-a9e6-b82b4f47c649 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:20.966355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:20.970862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:20.972333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:20.972333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:20.972333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:20.975271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:20.995908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:20.997601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:24:21.027472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:21.028445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:24:21.029465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:24:21.029465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:24:21.029465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:21.039391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 14/28] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:21.045292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.142334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebaced-b771-465f-ade8-4584e7dc83f3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.189930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.190922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:21.191704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.191924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.192153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.197424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91c302-a649-4800-a48a-092cf1041a6b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.209544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:21.214372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:21.215688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 15/29] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:21.216440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.244495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.245868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.246353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.246827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.247822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:21.248393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:21.250193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e738-d550-40bb-bbb6-c5706d2edac2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.263814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:21.266143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11aef0-4082-4f70-8e19-8f8a132951ed None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.266644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11aef0-4082-4f70-8e19-8f8a132951ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.267143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11aef0-4082-4f70-8e19-8f8a132951ed None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.269488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 16/31] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:21.270536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11aef0-4082-4f70-8e19-8f8a132951ed None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.291726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:21.334385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a886a76-12c4-47b8-a6c4-ed4f15bbe5f5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.372392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.373012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.373290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.373563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.374260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:21.377040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b9c3-ab37-478b-b36d-52294fc3d669 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.395043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11aef0-4082-4f70-8e19-8f8a132951ed None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.434007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.434626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.434912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.435223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.435895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:21.436204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:21.437861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.452912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 17/32] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:21.457089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.485309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:21.579185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cd46-929d-434f-842a-8fb682e2972b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.620598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.621238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.621590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.621910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.622957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:21.625027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5e35-f0e2-44c0-b600-ed5715669f68 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.627808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 16/33] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 17:24:21 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:21.629634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.630144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.630629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.670580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:21.673741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:21.759985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 17/34] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:21.760907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.827496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:21.875439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09aaa-8ecb-4245-96f4-de6858bbeb56 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:21.900577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 18/35] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:24:21 2022] POST /identity/v3/projects => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:21.903254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83c3-d415-4ca4-a6d6-a99b0b38fa37 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83c3-d415-4ca4-a6d6-a99b0b38fa37 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83c3-d415-4ca4-a6d6-a99b0b38fa37 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81126-037c-497c-bead-b5828ecddcba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81126-037c-497c-bead-b5828ecddcba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.916740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81126-037c-497c-bead-b5828ecddcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.917131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:21.917131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.917288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.917546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.918762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:21.920475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743773c8-7cfd-45c2-9099-bb8e479d4db8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:21.927125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 18/37] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:21 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:21.935299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec3c7-a89e-415d-9bb8-da5216a48dc5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:21.935616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec3c7-a89e-415d-9bb8-da5216a48dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:21.935865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec3c7-a89e-415d-9bb8-da5216a48dc5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:21.937297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 19/38] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:21.938100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeec3c7-a89e-415d-9bb8-da5216a48dc5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:21.945416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ee81126-037c-497c-bead-b5828ecddcba None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:21.947235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ee81126-037c-497c-bead-b5828ecddcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:22.038101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:22.039505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.039865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.040150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.055324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:22.079460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:22.082443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:22.102242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeec3c7-a89e-415d-9bb8-da5216a48dc5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.198211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 21/40] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:22.199758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:22.244032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:22.256020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.256671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.256954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.257928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.258345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.259844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.261802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 20/41] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:22.267908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:22.315499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e8e1b-9073-4613-9ad1-44c2f861661f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.350126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:22.356679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.357300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.357600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.357856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.359177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.360651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.376051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d3ab3-ade1-4272-99fa-0b48f9b65681 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.410809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.411518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.411822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.412128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] PATH_INFO: `/v3/domains/default/users/9e6b9970f28a4f428fe5a1ef6b19deeb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.414147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9e6b9970f28a4f428fe5a1ef6b19deeb, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.415681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.420445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 17:24:22 2022] POST /identity/v3/roles => generated 225 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:22.421382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:22.492202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 21/43] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Aug 24 17:24:22 2022] PUT /identity/v3/domains/default/users/9e6b9970f28a4f428fe5a1ef6b19deeb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:22.493083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:22.556638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a524e-1229-4f07-93c8-391c45cbe867 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.557691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:22.627252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.627939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.628232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.628512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.629697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.631926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d9203-3de3-43a0-b3b0-ff4ab386dc00 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.642248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7e79b-257c-476d-9ea2-e00b7094e5be None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.685323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.685966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.686248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.687343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.688593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.690042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.691662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:22.697608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:22.703026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 17:24:22 2022] POST /identity/v3/roles => generated 223 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:22.814711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40a01-faea-4032-871f-31db7d173e22 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:22.836184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:22.856562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:22.857188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:22.857476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:22.857765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:22.858417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:22.860162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec584899-949d-43b0-94d6-4c54ee45e20c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:22.955974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:24:22 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:24:24.475621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38ecd6-d54b-4421-91c9-692506db616f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:24.476174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38ecd6-d54b-4421-91c9-692506db616f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:24.476174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38ecd6-d54b-4421-91c9-692506db616f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:24.477543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:24.482866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003397f7-5500-4ef7-bd92-28808029436a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:24.483315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003397f7-5500-4ef7-bd92-28808029436a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:24.483645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003397f7-5500-4ef7-bd92-28808029436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:24.502042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-003397f7-5500-4ef7-bd92-28808029436a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:24.503310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-003397f7-5500-4ef7-bd92-28808029436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:24.576754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:24.862938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38ecd6-d54b-4421-91c9-692506db616f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:24.883063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca459f3-fe82-4bb1-9763-823bbd2d2cfe None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:24.883378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca459f3-fe82-4bb1-9763-823bbd2d2cfe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:24.883658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca459f3-fe82-4bb1-9763-823bbd2d2cfe None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:24.885023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 25/49] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:24.890845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:24.891177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:24.891462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:24.909424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:24.910655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:24.919483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:24.976334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38ecd6-d54b-4421-91c9-692506db616f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:24.985391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 26/50] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:25.014677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.015501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.015786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.016060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.028371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:25.034326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:25.035233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:25.035999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 25/51] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:25.041308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.075292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:25.149468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d9fdd-8c0e-4cfe-a8ff-12838af40618 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.185017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.185644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.185934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.186216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.187564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:25.187879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.189323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.198658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 27/52] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:25.205164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.253519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.318878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc48ae-4cb2-494a-a8db-4f2924e927e5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.333744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:25.355992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.356456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:25.356632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.357117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.357405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.359850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.361449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.363063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:25 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:25.365796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a827-a0cd-482e-b891-eed5ffebed88 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.368621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.400734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.401298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.401581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.401858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.403063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.404504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.406700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 28/54] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:25.412273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.470709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916062-eeff-44eb-860c-01bde60cc7ac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.504844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.505532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.505802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.506091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.507252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.508738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.510355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:25.514378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43326e2-6472-4378-9de0-900e2d2b97bf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.516966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:25.552255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.552866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.553150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.553427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.554066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.555610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1bb14-c6b1-4064-9e02-6a15f247aeea None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.566219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:25.618797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee310-845d-45dc-9c73-608d4c93d79d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:25.651221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:25.651769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.652056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.652337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.653059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.domain.id=default, user.id=9e6b9970f28a4f428fe5a1ef6b19deeb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:25.653370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:25.654836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e743fa-387d-4a66-bf55-243292391fa8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:25.663754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 28/56] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 17:24:25 2022] GET /identity/v3/role_assignments?user.id=9e6b9970f28a4f428fe5a1ef6b19deeb&scope.domain.id=default&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:25.694762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 29/57] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 17:24:25 2022] POST /identity/v3/projects => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:24:27.608658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e87-b7ed-442b-8f6f-72da95007a78 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:27.609206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e87-b7ed-442b-8f6f-72da95007a78 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:27.609206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e87-b7ed-442b-8f6f-72da95007a78 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:27.610547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 29/58] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:27.615817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:27.616224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:27.616377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:27.635547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:27.636736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:27.644569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:27.702922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 30/59] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:27.970354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e87-b7ed-442b-8f6f-72da95007a78 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:28.176530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e87-b7ed-442b-8f6f-72da95007a78 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:28.191230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:28.211822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:28.212465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:28.212750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:28.213030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:28.214155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:28.215655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e1ff-82e0-47eb-a6b5-41ee616826ba None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:28.217227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 30/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:28.223113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:28.321112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e2272-a2c9-460b-b35d-c4fcbd24cb07 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:28.354721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:28.355405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:28.355689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:28.356121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:28.356794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:28.358910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300904-d41d-4ca3-906b-aaca0c902964 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:28.459210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:28.464500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 31/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:28 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:31.395954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45428d-5586-4fa2-8a15-4f5e9c42067a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.396502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45428d-5586-4fa2-8a15-4f5e9c42067a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.396502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45428d-5586-4fa2-8a15-4f5e9c42067a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.398058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 31/62] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:31.406795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e611-75e2-4c19-b311-74da296e78c5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.406795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e611-75e2-4c19-b311-74da296e78c5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.406795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e611-75e2-4c19-b311-74da296e78c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.431403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9732e611-75e2-4c19-b311-74da296e78c5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:31.432989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9732e611-75e2-4c19-b311-74da296e78c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:31.525721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 32/63] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:31.550554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd444-e9b7-4a00-90ef-20a4a061ef38 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.551180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd444-e9b7-4a00-90ef-20a4a061ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.551725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd444-e9b7-4a00-90ef-20a4a061ef38 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.553456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 32/64] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:31.558911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e497-c22a-440c-b3b5-288db4447482 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.559268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e497-c22a-440c-b3b5-288db4447482 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.559555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e497-c22a-440c-b3b5-288db4447482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.584119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-93f1e497-c22a-440c-b3b5-288db4447482 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:31.585348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93f1e497-c22a-440c-b3b5-288db4447482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:31.681672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 33/65] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:31.818427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb2bb-b6c3-4b50-a528-7dde20bbb30c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.819162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb2bb-b6c3-4b50-a528-7dde20bbb30c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.819757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb2bb-b6c3-4b50-a528-7dde20bbb30c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.821438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 33/66] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:31.827567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac16-3e70-48b9-9720-125b90df994a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:31.828175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac16-3e70-48b9-9720-125b90df994a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:31.828679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac16-3e70-48b9-9720-125b90df994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:31.856795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-785bac16-3e70-48b9-9720-125b90df994a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:31.858340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-785bac16-3e70-48b9-9720-125b90df994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:31.918951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afb2bb-b6c3-4b50-a528-7dde20bbb30c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:31.931031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:31.950576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 34/67] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:32.001640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac16-3e70-48b9-9720-125b90df994a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.041165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afb2bb-b6c3-4b50-a528-7dde20bbb30c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.112287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.112947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.113235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.113513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.138740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:32.152343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:32.153464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:32.154431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:32.156372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 34/68] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:32.163931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.198044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac16-3e70-48b9-9720-125b90df994a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.213110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.273476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.274521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.275060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.276299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.298838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-16e882ec-921d-44a2-abde-bd0edb080ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:32.304671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:32.305544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:32.306313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:32.308738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:32.310762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e423c-8f63-42a8-981a-272f11fd6ee1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.310892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdfbe0-0150-42fa-88fc-f8f50dd0688f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.311395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e423c-8f63-42a8-981a-272f11fd6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.311889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e423c-8f63-42a8-981a-272f11fd6ee1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.313691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 36/70] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:32.314796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e423c-8f63-42a8-981a-272f11fd6ee1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.354024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.354639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.354924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.355235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.355911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:32.356217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:32.357616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7612-b241-4a87-b431-5069df823654 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:32.366848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:32.368146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.368436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.368713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.373171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.386255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:32.389255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:32.425274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e423c-8f63-42a8-981a-272f11fd6ee1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.456349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 36/72] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:32.457216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.471073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c84681-5873-406c-9168-28798a98e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.471668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84681-5873-406c-9168-28798a98e609 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.471959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84681-5873-406c-9168-28798a98e609 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.472239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84681-5873-406c-9168-28798a98e609 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.472922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c84681-5873-406c-9168-28798a98e609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:32.473227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c84681-5873-406c-9168-28798a98e609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:32.474651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c84681-5873-406c-9168-28798a98e609 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:32.483101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:32.484276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e387-1538-4052-a50c-2f9282677377 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.484563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e387-1538-4052-a50c-2f9282677377 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.484842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e387-1538-4052-a50c-2f9282677377 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.490463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 38/74] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:32.490463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e387-1538-4052-a50c-2f9282677377 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.497853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.580061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020d23d-e6ed-40db-8480-a5e403f2f316 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.597806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e387-1538-4052-a50c-2f9282677377 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.609351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.622486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.623233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.623771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.623771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.634596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.635397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.635694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.635811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:32.636016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:32.640488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:32.641362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:32.642154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:32.647346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.651827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:32.653385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d6631-1300-4654-b221-58d690ac533d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:32.655129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:32.656389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.656686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.657036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.680260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:32.681672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:32.749623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.758292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 40/77] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:32.759180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.759396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a0d8e-3860-4705-85e8-dce650ceb778 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.795857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.796506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.796794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.797078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.798807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:32.800346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:32.806569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 38/78] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:32.806569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.867942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:32.872887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa2964-4a09-4ca6-ad7e-b5cfe2ee4fc5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.909671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.910259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6a999-dd1f-432f-b4b6-2d114747ae26 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:32.910363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.910568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.910849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.911561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:32.911875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:32.913300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:32.922328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 41/79] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:32.927701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:32.956287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:32.956971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:32.957256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:32.957540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:32.990513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.054868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176685-d8af-407c-9c71-fc570bc7b594 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.103418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.103418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.103661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.103661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.103661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.103661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.103983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:33.107393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:33.108299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:33.109064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 42/80] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:33.109711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.132659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.164174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 39/81] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:33.165848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.212507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676244ee-6518-44b2-b23e-37beb32f844b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.225968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.249382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.250105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.250393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.250833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.270406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4f05-6517-47fe-ae61-0b6b52faa67e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.305044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.305608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.305897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.306181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.307376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.308876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.310505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 40/82] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:33.311328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.321196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.322690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.343967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.429400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed04e3-98a2-4d6d-8d51-58cce0e40b68 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.437290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 43/83] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:33.438203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.460300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.468286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.469685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.469685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.469685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.471061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.472600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.474169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 41/84] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:33.474981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.546129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103efcb3-b59e-44d5-9a37-862b60887e16 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.567022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.581049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006782c-2c5f-45cd-a420-911185bdf7af None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.581298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.581797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.582080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.582798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.583530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:33.583841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.585294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.594304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 44/85] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:33.595639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.617732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.618367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.618649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.619355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.620507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.621951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.623616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 42/86] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:33.624374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.693608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.704467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bc90-906e-4319-a0a2-038779fa2376 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.738288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8bf62-cfd1-4d74-82c8-28ff49b5ce80 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.742726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.743381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.743665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.743965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.775619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.776254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.776557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.776838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.777962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.779450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.781091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 43/87] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:33.782413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.795033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.814972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.816510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:33.890121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3417-3638-40e3-82fd-01ad73ed859e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:33.919075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 45/88] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:33.919957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:33.926334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:33.931674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:33.932287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:33.932569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:33.932841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:33.933545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:33.934981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.000555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:34.017919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c732d7-0f0a-414d-a2c6-a490945785c9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.024999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 44/89] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:33 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:34.028406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.061498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.062264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.062539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.062819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.064659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.066145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.067838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 46/90] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:33 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:34.068651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.169322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8b96b-c0bf-4f27-a3ba-92abd96267b9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.198412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07005ca-ba87-4c8b-8f8e-d1a33131c500 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.215214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.216180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.216459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.216735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.217473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=882f064a2b264510bf73482a34370172) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:34.217784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.219280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.227252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 45/91] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:34.229528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.249878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.252107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.252107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.252107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.255383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=9e6b9970f28a4f428fe5a1ef6b19deeb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:34.255383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.255383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.263605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 47/92] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/role_assignments?user.id=9e6b9970f28a4f428fe5a1ef6b19deeb&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:34.264892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.287512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:34.314881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:34.409302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02856e7-6e5c-4ee7-8c51-9bf5bfc14b01 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.432505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99088-1cb9-4f7e-a21d-35ff03206ca3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.457362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.458882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.460174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.460700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.463361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.465541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.467894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 46/93] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:34.475339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.480719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.481943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.482400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.482834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.568970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.570857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.592748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:34.623374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2b36-f0a6-41b1-8862-5953e5e3440d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.650228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:34.677526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.678170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.678464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.678754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.679538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=882f064a2b264510bf73482a34370172) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:34.679861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.681390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.693962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 47/94] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=528d204588504e4a8b4c5fe1294470af => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:34.700552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 48/95] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:34.708579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:34.866492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4bbac-7f45-47e0-8915-d329bba3e74b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:34.903340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:34.903979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:34.904259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:34.904527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] PATH_INFO: `/v3/projects/75556fc47efa4996bc9852a54f917308` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:34.905656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] RBAC: Authorizing `identity:get_project(project_id=75556fc47efa4996bc9852a54f917308)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:34.907357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4679e-8e0a-423e-819b-5bb6ec4144a6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:34.909005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 48/96] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/projects/75556fc47efa4996bc9852a54f917308 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:34.915904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:35.085469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c49a5-be24-42d8-ad9d-0d8f2292d4c4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:35.103583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:35.122972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:35.123967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:35.124454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:35.125186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:35.126656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=75556fc47efa4996bc9852a54f917308, user.id=882f064a2b264510bf73482a34370172) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:35.127205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:35.128884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45636393-3bfd-4bab-9206-673d1a58dace None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:35.135462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 49/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:34 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=75556fc47efa4996bc9852a54f917308&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:36.808258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4e34-2855-4478-ad5f-a57c4f04a32e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:36.808797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4e34-2855-4478-ad5f-a57c4f04a32e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:36.808797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4e34-2855-4478-ad5f-a57c4f04a32e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:36.810175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 49/98] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:36.816123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b715-1e01-43b1-839c-8b1fd4c7c08e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:36.817026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b715-1e01-43b1-839c-8b1fd4c7c08e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:36.817525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b715-1e01-43b1-839c-8b1fd4c7c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:36.844765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1ef4b715-1e01-43b1-839c-8b1fd4c7c08e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:36.846410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ef4b715-1e01-43b1-839c-8b1fd4c7c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:36.941553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 50/99] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:37.010614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34644f0a-a292-4a9b-8fc4-901e5c82f69d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.010925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34644f0a-a292-4a9b-8fc4-901e5c82f69d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.011209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34644f0a-a292-4a9b-8fc4-901e5c82f69d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.012567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 50/100] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:37.018582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3d2f-6aa1-45a1-bdfa-4e4b2b5ffb5d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.019181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3d2f-6aa1-45a1-bdfa-4e4b2b5ffb5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.019680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3d2f-6aa1-45a1-bdfa-4e4b2b5ffb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.044103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0e9d3d2f-6aa1-45a1-bdfa-4e4b2b5ffb5d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:37.045679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e9d3d2f-6aa1-45a1-bdfa-4e4b2b5ffb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:37.129302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 51/101] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:37.273144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc55f-c62f-45cc-a25c-8ea23fc957ec None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.273521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc55f-c62f-45cc-a25c-8ea23fc957ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.273707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc55f-c62f-45cc-a25c-8ea23fc957ec None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.275100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 51/102] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:37.280969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.281606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.282185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.310951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:37.312569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:37.355116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:37.410343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 52/103] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:37.462184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc55f-c62f-45cc-a25c-8ea23fc957ec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:37.538168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:37.550394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:37.675192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc55f-c62f-45cc-a25c-8ea23fc957ec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:37.753214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:37.754005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.754205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.754478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.758831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331790e-e700-4bd3-b02d-e484de6b2065 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:37.779311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:37.785284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:37.786125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:37.786954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 52/104] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:37.796232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:37.816890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:37.818243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.818946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.820117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:37.845374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:37.850310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:37.851832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:37.852607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 53/105] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:37.853356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:37.890252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:37.944619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a3b3-43cd-4d20-826b-4d26bbce22b7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:37.965209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:37.981505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c624c8-6a1b-4292-99ba-89fd772ca674 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:37.993045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:37.993701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:37.994369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:37.995158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.008381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-cf58dd1f-59d1-4110-b390-a1324b7602f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:38.013175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:38.014044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:38.014843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 53/106] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:38.016861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64011a-acb3-435a-9217-c8800a5e52f9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.016861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64011a-acb3-435a-9217-c8800a5e52f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.016861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64011a-acb3-435a-9217-c8800a5e52f9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.018361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 54/107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:38.023321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bc44-79e0-4a7a-a8ea-4939df96b01f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.023620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bc44-79e0-4a7a-a8ea-4939df96b01f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.023903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bc44-79e0-4a7a-a8ea-4939df96b01f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.025378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 55/108] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:38.025929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623bc44-79e0-4a7a-a8ea-4939df96b01f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.028149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.029443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.030794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.031103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.031924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:38.032235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.033695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.046624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 54/109] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.052352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.142850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623bc44-79e0-4a7a-a8ea-4939df96b01f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.156427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.166923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c10947-5654-4a54-8d62-dc5402ecdbc5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.182646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.183301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.183580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.183856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.184531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:38.184834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.186234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828f7ae-903f-4894-931a-86c8426b59a8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.195205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 56/110] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.196356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.196641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.196918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.208271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.208889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.209173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.209450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.210125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:38.210429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.211842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36db121-42f5-474b-a89a-300794b059a0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.214787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:38.216022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:38.220741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 55/111] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.221939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1394a-7444-4e22-9277-723dbb7b4027 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.222231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1394a-7444-4e22-9277-723dbb7b4027 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.222510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1394a-7444-4e22-9277-723dbb7b4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.240687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d6e1394a-7444-4e22-9277-723dbb7b4027 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:38.241894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6e1394a-7444-4e22-9277-723dbb7b4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:38.245091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.286001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 57/112] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:38.286983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 56/113] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ac01-a8a4-4a3e-8275-372c840fc112 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ac01-a8a4-4a3e-8275-372c840fc112 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ac01-a8a4-4a3e-8275-372c840fc112 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 57/114] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:38.321794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78ac01-a8a4-4a3e-8275-372c840fc112 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.418945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1459f-0c5e-41c2-b4b7-2db5f1ba9fc0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.457934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.458576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.458865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.459166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] PATH_INFO: `/v3/users/196ef5d6680c44c49db0ac7d5595e181` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.472283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.480656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] RBAC: Authorizing `identity:get_user(user_id=196ef5d6680c44c49db0ac7d5595e181)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.482127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.484063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 58/115] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/users/196ef5d6680c44c49db0ac7d5595e181 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.484682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.499109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78ac01-a8a4-4a3e-8275-372c840fc112 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.519631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.548650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.549979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.550468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.550943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.552408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.555333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e93a-da1b-4932-adc0-4e02c7467e12 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.557917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 58/116] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.559347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.559839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.560332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.580226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:38.581611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:38.618377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548903-c88a-460c-b7dd-3b48d00907a3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.655444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.656117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.656413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.656728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.657359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 59/117] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:38.657973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.658206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.659484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.661128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 59/118] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.661912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.760396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.772835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.783772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421894a-cbb6-4687-8156-a96da10fa28d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.783964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16268-197e-4432-b7ac-19daf5cf35d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.825061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.825717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.825822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.826100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.826376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.827039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.827527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.827646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.828140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.829405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.831225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 60/119] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:38.832020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.911065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.912881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.945394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacea07-c332-44a9-a367-d2239082bde5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.982854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.983511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.983792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.984067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.994707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:38.996022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:38.999601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:39.001346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 61/120] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:39.002244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.018134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 60/121] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:39.018879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.026211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.113570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-2a87-4e42-a2b4-70c103fc52fb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.122808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc091-ec10-4716-8921-8364a3a106b0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.149376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.150011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.150315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.150590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.151716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.153185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.155156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 62/122] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:39.155550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.157862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.158503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.158786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.159379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.160426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.161930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.163630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 61/123] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:39.164466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.216679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.247597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.263128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeaecc-c07a-4cbc-927c-10af2a0b407a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.268673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63850b32-da89-41d4-be19-cf6bf4798b56 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.298144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.298815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.299125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.299411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/882f064a2b264510bf73482a34370172/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.301690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, user_id=882f064a2b264510bf73482a34370172, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.303453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.303821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.304092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.304377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.304656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.315687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:39.320894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:39.321899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:39.322742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 62/124] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:39.323787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.373297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 63/125] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:39 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/882f064a2b264510bf73482a34370172/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:39.374174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.435219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83509b-d92c-4590-9937-f9cbdc823bee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.446739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.475703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.476463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.476820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.477166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.477928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:39.478892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.480515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.494376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0387c-275c-4bec-800a-99a8fbc09e0b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.495154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 63/126] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:39.496547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.540557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.541290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.541677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.542068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.543339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.544841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.546547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 64/127] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:39.549314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.570699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.620495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb24c-9ea9-49c9-8c0a-ab2de6b346e0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.655609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.656238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.656526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.657337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.657988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.659476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.669848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f6e5-da7e-43e1-aa25-2878f2b1f630 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.706576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.707288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.707578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.707857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/9e6b9970f28a4f428fe5a1ef6b19deeb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.709834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, user_id=9e6b9970f28a4f428fe5a1ef6b19deeb, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.711343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.755371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 64/128] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:24:39 2022] POST /identity/v3/projects => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:39.756168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.789473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:39.854369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 65/129] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:39 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/9e6b9970f28a4f428fe5a1ef6b19deeb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:39.855787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:39.905084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a18a8-16dc-4d3e-a4c9-8532ca472c9b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.970067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.970804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.970992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.971330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.972025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:39.972345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.973801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.996126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 65/130] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:39.997102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.002598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:40.029656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55de505-66bc-40c7-8390-51dd9ece224a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.074069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.074897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.075216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.075499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.076706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.078194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.080678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 66/131] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:40.081265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.121315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:40.139500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b9ae-2995-4d14-abf8-b9b6ac335ba4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.202014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.202654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.202943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.203256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.204569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=196ef5d6680c44c49db0ac7d5595e181) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:40.205023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.206785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.219113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 66/132] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:39 2022] GET /identity/v3/role_assignments?user.id=196ef5d6680c44c49db0ac7d5595e181&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:40.219113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.235662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee6ff-537a-44da-91fc-2e067b0fc0a7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.303170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.303896 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.304183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.304466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.305791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.313219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.315124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 67/133] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:40 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:40.321148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.358572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:40.467283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c45b2-5bf3-4983-ac44-cb42ed7e301a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.531891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.532669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.535944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.536239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.537826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.540127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.542123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 67/134] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:40 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:40.548244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.551465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d3e9-2486-4ae4-b2d6-1910e2bab4dc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.581376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:40.604864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.605708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.606103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.606544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] PATH_INFO: `/v3/projects/75556fc47efa4996bc9852a54f917308` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.607854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] RBAC: Authorizing `identity:get_project(project_id=75556fc47efa4996bc9852a54f917308)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.609416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.620247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 68/135] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:40 2022] GET /identity/v3/projects/75556fc47efa4996bc9852a54f917308 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:40.626657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:40.746586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7943-4dd3-4109-82ff-ede426350dd6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.772984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:40.824940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.825733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.826027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.826303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/882f064a2b264510bf73482a34370172/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.826842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5ff1-1c01-43e8-a939-0400536cb6fe None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:40.829254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, user_id=882f064a2b264510bf73482a34370172, role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.831516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35934674-b8ba-49b9-b18f-7103d78bb6a5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.872517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:40.873189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:40.873524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:40.873806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] PATH_INFO: `/v3/projects/75556fc47efa4996bc9852a54f917308/users/882f064a2b264510bf73482a34370172/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:40.876823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] RBAC: Authorizing `identity:create_grant(project_id=75556fc47efa4996bc9852a54f917308, user_id=882f064a2b264510bf73482a34370172, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:40.878354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8460280-8bb3-474a-a87b-ecfd4ec6fe7b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:40.916856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 68/136] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:40 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/882f064a2b264510bf73482a34370172/roles/528d204588504e4a8b4c5fe1294470af => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:40.974474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 69/137] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:40 2022] PUT /identity/v3/projects/75556fc47efa4996bc9852a54f917308/users/882f064a2b264510bf73482a34370172/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:42.017892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ffca-4546-47b5-bcf3-2bc7676fce59 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.018391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ffca-4546-47b5-bcf3-2bc7676fce59 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.018462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ffca-4546-47b5-bcf3-2bc7676fce59 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.020064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 69/138] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:42.025444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa5997-569d-4d46-b9e6-3dcc212a5081 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.025918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa5997-569d-4d46-b9e6-3dcc212a5081 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.026103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa5997-569d-4d46-b9e6-3dcc212a5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.052486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3eaa5997-569d-4d46-b9e6-3dcc212a5081 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:42.053714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3eaa5997-569d-4d46-b9e6-3dcc212a5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:42.145619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 70/139] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:42.284555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff99d1-32bf-43c8-8acd-cbd159ee8ab8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.284865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff99d1-32bf-43c8-8acd-cbd159ee8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.285037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff99d1-32bf-43c8-8acd-cbd159ee8ab8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.286625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 70/140] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:42.291989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc60a5-6112-4c73-a906-6e7455c60ae3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.292282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc60a5-6112-4c73-a906-6e7455c60ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.292564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc60a5-6112-4c73-a906-6e7455c60ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.320386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4ffc60a5-6112-4c73-a906-6e7455c60ae3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:42.321616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ffc60a5-6112-4c73-a906-6e7455c60ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:42.404979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:42.416163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 71/141] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:42.737810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff99d1-32bf-43c8-8acd-cbd159ee8ab8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:42.805080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa192bb-25f2-4cff-b5e5-47bc012791c4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.805413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa192bb-25f2-4cff-b5e5-47bc012791c4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.805628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa192bb-25f2-4cff-b5e5-47bc012791c4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.807345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 72/142] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:42.812951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.813247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.813526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.838850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:42.840014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:42.872232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:42.912560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff99d1-32bf-43c8-8acd-cbd159ee8ab8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:42.949589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 73/143] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:42.950563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:42.957092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:42.958089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.958564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.959032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.974504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:42.980887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:42.981732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:42.982469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:42.985925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 71/144] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:42.992064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.081578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5276f42-42b9-46f8-a208-db6f214dd0ce None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.110560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36db24-784a-41bc-ae55-e92eead0fe7d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.119635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:43.130722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.131534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.131876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.132212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.133875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.135292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.141505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 74/145] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:43.143944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.172808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.173444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.173776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.173990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.174665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:43.174972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.176433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beea51-119a-46b8-9c3f-5590c92b6705 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.178889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:43.186246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 72/146] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:43.188651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a57e-e80f-4614-b970-b780bedddbf1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.188651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a57e-e80f-4614-b970-b780bedddbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.188820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a57e-e80f-4614-b970-b780bedddbf1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.191117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 73/147] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:43.195575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.195867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.200945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.220643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:43.221883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:43.283346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098776cb-05c1-4ccb-9617-dddb79163497 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.321493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 74/148] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:43.322171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.368813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.370241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.370525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.370800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.371742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.374721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.479257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ef26-4a93-4c62-a381-5cc9f51a047f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.508474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:43.517582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.518575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.519160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.524752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.524752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.524752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.524752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 75/149] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:43 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:43.529129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 75/150] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:43 2022] POST /identity/v3/users => generated 283 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:43.529658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.532231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.647337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:43.716261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1abdc-127c-4377-8140-49370891a0bc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.731645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d1f4-115f-4900-b03e-6da65424e806 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.782636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.783501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.783787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.784062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.796878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.798501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.798990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.799482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.811774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:43.827318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:43.828272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 76/151] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:43.834378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.894312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.896507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251aed6-9264-4ea7-baf4-2bb9a721074b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.903988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:43.959342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41559-0a10-4bb6-8b29-43b2e493813e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.978956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.007829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.008866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.009359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.009835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.024449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:44.032290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:44.033189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:44.034093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 77/152] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:44.034807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.048794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 76/153] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:44.049967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d98b3-fbd6-420e-81ca-c2438eb07321 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.050357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d98b3-fbd6-420e-81ca-c2438eb07321 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.050549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d98b3-fbd6-420e-81ca-c2438eb07321 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.052138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 77/154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:44.052880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d98b3-fbd6-420e-81ca-c2438eb07321 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.167562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ad8e-1520-4eb3-b628-ec2a18bc5690 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.186263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d98b3-fbd6-420e-81ca-c2438eb07321 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.190668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.213573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.214545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.214936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.215235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.215923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:44.216228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.217811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.229967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 78/155] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.231572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.236689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.237318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.237599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.237869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.238679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:44.238985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.240411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f53d32-d3e9-4887-a270-9c0d758d2727 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.249604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 78/156] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.250892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e889-648f-454d-8fd7-6ff40c03d363 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.251231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e889-648f-454d-8fd7-6ff40c03d363 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.251569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e889-648f-454d-8fd7-6ff40c03d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.277925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1063e889-648f-454d-8fd7-6ff40c03d363 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:44.279222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1063e889-648f-454d-8fd7-6ff40c03d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:44.290935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.368088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860626-6da4-4df7-a27f-8b705d7ebb2e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.369408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 79/157] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:44.371004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb59a3-eb17-4cba-8f80-d3cfc051ee8b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.371537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb59a3-eb17-4cba-8f80-d3cfc051ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.371923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb59a3-eb17-4cba-8f80-d3cfc051ee8b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.373572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 80/158] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:44.374677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb59a3-eb17-4cba-8f80-d3cfc051ee8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.414566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.415417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.415821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.416170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.419172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.419962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.421979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 79/159] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.422885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.492812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.527425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb59a3-eb17-4cba-8f80-d3cfc051ee8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.552253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15ddf8-8732-487c-bb00-eb282d0a81dd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.569103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.570288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.570777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.571284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] PATH_INFO: `/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.572692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] RBAC: Authorizing `identity:get_user(user_id=9e6b9970f28a4f428fe5a1ef6b19deeb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.574813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9bbe6-1d5f-4951-9f4f-e9c681f4d345 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.577365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 81/160] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/users/9e6b9970f28a4f428fe5a1ef6b19deeb => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.580468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.581087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.581577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.600158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.603778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:44.604138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.604351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:44.604842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.605388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] PATH_INFO: `/v3/users/196ef5d6680c44c49db0ac7d5595e181` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.606992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] RBAC: Authorizing `identity:get_user(user_id=196ef5d6680c44c49db0ac7d5595e181)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.610572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.614419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.616039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 80/161] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/users/196ef5d6680c44c49db0ac7d5595e181 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.617651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.704107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 82/162] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:44.705361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.766936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad68a9e-2e61-40dc-8f04-03fe0f92bc41 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.788113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.811208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.811826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.812104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.812377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.813327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=882f064a2b264510bf73482a34370172) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:44.813569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.815333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.822175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 81/163] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:44.827106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.877859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aed54d-6692-4629-9a3e-ff4993e875e1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.960263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.960538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.960797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.961095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.982950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.988563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037859-63a0-47f3-9eb6-71a40828cfd0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.042702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.043877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.044447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.044919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.048338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.049839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.051592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 82/164] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:45.052383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.087069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.088618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.140231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:45.208923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009723bf-4d73-4977-bbd0-5b606c47ad6e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.286452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 83/165] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:45.287258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.288417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.289072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.289354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.289628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.315494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:45.320898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:45.321839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:45.322644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 83/166] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:45.323763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.350993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:45.426692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8a16-c6ae-4529-bc17-7b0af8ae10b8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.470863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.471732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.472638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.473020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/196ef5d6680c44c49db0ac7d5595e181/roles/516aaa21a1694adca0d7b42c05db00d6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.475394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, user_id=196ef5d6680c44c49db0ac7d5595e181, role_id=516aaa21a1694adca0d7b42c05db00d6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.477127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.524001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a57-30d2-4252-989d-f7061cabbea7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.532531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:45.555925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 84/167] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:45 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/users/196ef5d6680c44c49db0ac7d5595e181/roles/516aaa21a1694adca0d7b42c05db00d6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:45.556734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.594726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.595406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.595689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.595962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.630752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:45.637858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:45.638759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:45.639658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:45.644786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 84/168] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:45.652671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.802612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098df7-ac56-476a-8978-d2b00a2cbdaa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.804695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:45.874283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.875541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.876055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.876526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.878063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.879830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.882291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 85/169] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:45 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:45.883339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.889365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3861e-6dec-4f65-9905-1ba50e3582ab None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.995840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.996476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.996766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.997042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.997727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:45.998037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.999494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.004241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d200f-2a7c-4fe8-9f00-1714efd47210 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.014814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 85/170] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:46.015764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.043773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.044777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.045275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.045774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.046712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:46.047824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.049429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.060683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 86/171] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:46.061985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.096927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.099702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.177018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b1781-8682-43b0-8660-6347dcd408c9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.217883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.219061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.219585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.220172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.221776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.223574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.225640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 87/172] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:46.226888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.309418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe2d7e-7410-4e20-81fa-5a5098e65495 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.338642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.342959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6c3a-0100-4b51-9475-52301a441ca2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.380429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.381548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.382092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.382575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] PATH_INFO: `/v3/users/882f064a2b264510bf73482a34370172` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.384093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] RBAC: Authorizing `identity:get_user(user_id=882f064a2b264510bf73482a34370172)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.385115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.386075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.386190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.386614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.387120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.388444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=9e6b9970f28a4f428fe5a1ef6b19deeb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:46.388699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 88/173] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/users/882f064a2b264510bf73482a34370172 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:46.389018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.389892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.392229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.412163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 86/174] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/role_assignments?user.id=9e6b9970f28a4f428fe5a1ef6b19deeb&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:46.413671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.506407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2b931-e55a-4fa5-81f2-2305a75c6a77 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.549232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.550381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.550882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.551393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.596974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.627163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.649084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c19eb8-2b32-49e1-9ad1-41801c508c63 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.693300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.694293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.694782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.695443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.696261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.698128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.785252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.787168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.939952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.948571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 89/175] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:46.952892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.971495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 87/176] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:46.976989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.074919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:47.116751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a842-fa53-45bd-bb4f-366cb63d8bd9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.165899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.167293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.167789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.169356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] PATH_INFO: `/v3/projects/75556fc47efa4996bc9852a54f917308` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.170946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] RBAC: Authorizing `identity:get_project(project_id=75556fc47efa4996bc9852a54f917308)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.174929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.178153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 90/177] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/projects/75556fc47efa4996bc9852a54f917308 => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:47.184516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.234139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80697-3310-4493-a7b1-dba9462a892e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.308778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.309834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.310785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.311338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.313750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.318469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3040-3e52-488a-8a43-820cda6052d4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.323386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 88/178] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:47.325830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963b26-e1a4-43ee-93d8-8343c7c8bb9a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.327850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963b26-e1a4-43ee-93d8-8343c7c8bb9a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.328984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963b26-e1a4-43ee-93d8-8343c7c8bb9a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.333094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 89/179] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:47.337928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963b26-e1a4-43ee-93d8-8343c7c8bb9a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.395631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c63fe5-e450-4910-969f-0e2a7f9b7989 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.442908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:47.476860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.477755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.478567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.478866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.479951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=75556fc47efa4996bc9852a54f917308, user.id=882f064a2b264510bf73482a34370172) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:47.480271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.482479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801a181-8563-4c72-abd3-adb081970a76 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.486527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:47.492208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 91/180] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:47 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=75556fc47efa4996bc9852a54f917308&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:47.494442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c9ca-56e1-46b5-91b9-69e4c30506f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.494735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c9ca-56e1-46b5-91b9-69e4c30506f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.495017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c9ca-56e1-46b5-91b9-69e4c30506f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.517118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963b26-e1a4-43ee-93d8-8343c7c8bb9a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.524332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-87e7c9ca-56e1-46b5-91b9-69e4c30506f5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:47.526831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87e7c9ca-56e1-46b5-91b9-69e4c30506f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:47.563605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.564140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.564416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.564690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.565491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=882f064a2b264510bf73482a34370172) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:47.565805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.569330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03316c3-2b72-440a-992f-690560ab1f5b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.578193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 90/181] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:47 2022] GET /identity/v3/role_assignments?user.id=882f064a2b264510bf73482a34370172&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=528d204588504e4a8b4c5fe1294470af => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:47.579658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-fd1a-43ef-b52f-30454d9ebf80 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.579948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-fd1a-43ef-b52f-30454d9ebf80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.580226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-fd1a-43ef-b52f-30454d9ebf80 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.581733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 91/182] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:47.585262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2911f-0c99-4907-a524-83d28ae708c0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.585262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2911f-0c99-4907-a524-83d28ae708c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.585262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2911f-0c99-4907-a524-83d28ae708c0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.588197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 92/183] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:47.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.590435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.591028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.645388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:47.646639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:47.680796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 92/184] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:47.682316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.682953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.683256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.709424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:47.710741 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:47.768415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 93/185] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:47.791260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 93/186] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:48.022674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.069751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.107580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.140042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.164936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2766cc-d416-4c1a-abbe-10efa5205c61 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.199185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddf757-50bd-4bf1-ad03-26a1dbeb25ec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.213808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.215109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.215698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.216162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.234830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:48.243654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:48.244682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:48.245525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 94/187] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:48.246196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.264990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.264990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.264990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.264990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.278054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:48.283587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:48.284905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 94/188] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:48.285877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.385446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf6197-dfbb-4464-ab0c-c2667121f511 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.402800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.416930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aa011-f147-4a0c-b713-7af8072a2699 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.425159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.425806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.426087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.426364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.427542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.429012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.430647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 95/189] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:48.431488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.451289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.467151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.467544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.467795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.468069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.469301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:48.469749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.471165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.480528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 95/190] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:48.481261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.554696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fcc13-b1cc-4faf-a695-5be21fd215d9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.593704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.594551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.594955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.595275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.595941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:48.596244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.597655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.608129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 96/191] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:48.608321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b345-4589-47db-bc0d-56115307f561 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.608781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.648305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.648928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.649215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.649487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.650139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.651626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc3194-8d56-43de-ae2c-79eb54f17aff None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.665638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.736955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b441-7ffe-445d-9791-94e4b98d12ba None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.766289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 96/192] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:48 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:48.767805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4786a2-ce8b-4c0e-9162-5917285131be None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.768091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4786a2-ce8b-4c0e-9162-5917285131be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.768363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4786a2-ce8b-4c0e-9162-5917285131be None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.769747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 97/193] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:48.770519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4786a2-ce8b-4c0e-9162-5917285131be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.785637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.787034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.787499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.787957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.815720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.817772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818508e-8152-40eb-a8a0-0cec2056bdb1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.819817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 97/194] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:48.820932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.821218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.821494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.840985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.843143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:48.844727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:48.938166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4786a2-ce8b-4c0e-9162-5917285131be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.940758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 98/195] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:48.943297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.983990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.988931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.989794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.991024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.991502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.992997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.994544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.996240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 98/196] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:49.001979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.087690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb28d-f3c6-4c92-81bd-94bf67124617 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.150020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.150940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.151427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.151697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.169012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93349916-52f1-4cc0-b850-ee01ecf0872f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.179853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.223701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.225004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.225441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.225894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.270025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:49.271825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:49.317468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.321394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:49.324063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:49.407335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 99/197] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:49.408300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.463076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 99/198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 17:24:49.464322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.475908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.533333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eff90-5036-49e0-807b-f13745b800d9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.579745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.585010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.585650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.585927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.586196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.601667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:49.605816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55257b6-8ec2-47a0-be3c-52c398814664 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:49.606507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:49.607522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:49.608296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 100/199] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:49.608955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.657768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.658748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.659113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.659473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.661557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:49.663452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:49.666258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 100/200] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:49.667072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.747943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbe35-d4f6-4629-bdf7-aa771c6dd41f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.789057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.789934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.790313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.790685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.791959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:49.793605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:49.795356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 101/201] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:49.800122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.808519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00a6e-306f-4212-acb4-bf7edd4c8784 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.811540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.864207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.865510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.865794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:49.866071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:49.866763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:49.867069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:49.869049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:49.881110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 101/202] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:49.882585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:49.890483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:49.946779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15002-ff25-4890-b3fc-4f945cef443e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:49.998372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:49.999205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:49.999591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:50.000445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:50.001776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=1959380433154690b2da4aa4489eac95) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:50.002330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:50.004102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:50.011694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 102/203] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/role_assignments?user.id=1959380433154690b2da4aa4489eac95&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:50.016814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:50.046978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92a6e-3a8a-4320-9fe7-8ccf71761f61 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:50.133813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:50.134443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:50.134726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:50.135000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:50.135771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=1959380433154690b2da4aa4489eac95) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:50.136075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:50.137553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:50.141337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:50.152629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 102/204] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:49 2022] GET /identity/v3/role_assignments?user.id=1959380433154690b2da4aa4489eac95&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=528d204588504e4a8b4c5fe1294470af => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:50.199518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efef8-3ba6-4214-8384-3d1a2a4afc57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:50.231475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:50.244540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:50.245516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:50.245966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:50.250320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] PATH_INFO: `/v3/users/196ef5d6680c44c49db0ac7d5595e181` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:50.250320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] RBAC: Authorizing `identity:get_user(user_id=196ef5d6680c44c49db0ac7d5595e181)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:50.250320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:50.251840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 103/205] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:50 2022] GET /identity/v3/users/196ef5d6680c44c49db0ac7d5595e181 => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:50.257581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:50.392905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180eedf-541c-46d9-8cb7-9d2b51dff0b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:50.433732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:50.434704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:50.435259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:50.435732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:50.527157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:50.533309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:50.534803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:50.672582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 103/206] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:50.678633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:50.842448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987ee89-08af-4031-a966-d4faf9e0ce01 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:50.885902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:50.886547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:50.886829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:50.887121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:50.891588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:50.893050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380eadc-1121-4e4e-96d2-fab08d544eb7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:50.895009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 104/207] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:50 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:50.900978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:51.032564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:51.035727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753f29-c16a-4814-bd65-4f456fd2d847 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:51.082357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:51.083379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.083853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.084333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.085268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546, user.id=196ef5d6680c44c49db0ac7d5595e181) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:51.085766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:51.087424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5340b2-0abd-486b-bc8d-84435e581393 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:51.094600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 104/208] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:50 2022] GET /identity/v3/role_assignments?user.id=196ef5d6680c44c49db0ac7d5595e181&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:51.137103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac667-5299-4b8e-b58b-e6d2489f338b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.137469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac667-5299-4b8e-b58b-e6d2489f338b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.137651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac667-5299-4b8e-b58b-e6d2489f338b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.139195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 105/209] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:51.149097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e4ff-01c1-4112-896b-119babc40f48 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.149411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e4ff-01c1-4112-896b-119babc40f48 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.149648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e4ff-01c1-4112-896b-119babc40f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.176547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2504e4ff-01c1-4112-896b-119babc40f48 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:51.177786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2504e4ff-01c1-4112-896b-119babc40f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:51.273940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 105/210] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:51.577836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac667-5299-4b8e-b58b-e6d2489f338b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:51.604826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716675e1-aab9-418c-a6ec-c02d507e100d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.605378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716675e1-aab9-418c-a6ec-c02d507e100d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.605378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716675e1-aab9-418c-a6ec-c02d507e100d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.606722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 106/211] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:51.613359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.613646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.613921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.643345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:51.644711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:51.658504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:51.721106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac667-5299-4b8e-b58b-e6d2489f338b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:51.738014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 107/212] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:24:51.762000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:51.762700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.762979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.763279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.775642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:51.780849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:51.782311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:51.783258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 106/213] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:51.788585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:51.817365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:51.902704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fc17-19ad-418f-bc75-30214e48f0da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:51.941432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:51.942062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:51.942342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:51.942619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:51.943325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:51.943630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:51.945112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:51.955729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 108/214] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:51.961922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.032047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.098177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98f16-0ee4-437f-b246-bd2f8932c4be None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.121631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.138986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.139715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.139952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.140227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] PATH_INFO: `/v3/users/55945bbf4feb4c1e88e91fb760194df4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.148987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.159779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] RBAC: Authorizing `identity:get_user(user_id=55945bbf4feb4c1e88e91fb760194df4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.161180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.163197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 107/215] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:51 2022] GET /identity/v3/users/55945bbf4feb4c1e88e91fb760194df4 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:52.170003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.177596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaaacc-6997-4a32-a11f-cb7a74d946d9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.224927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.227333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.227899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.228437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.230251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.232887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.235861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 109/216] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:52.241847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.322390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ef4f-b115-45aa-af19-7b09fde19303 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.367206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caadbd-e9fe-4b4d-8321-05dea6e17024 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.373027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.374079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.374561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.376009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.408052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.408349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.408659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.408933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.409588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.411114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53eebc-a1ff-4f80-9a87-99410a2289b8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.432078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.454818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.456357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ab5e-f383-49d3-a466-767a75de4778 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.519243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 110/217] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:52 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbf45-05e5-43ef-83a7-a38bb1dacb45 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbf45-05e5-43ef-83a7-a38bb1dacb45 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbf45-05e5-43ef-83a7-a38bb1dacb45 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 111/218] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc5ad1-376a-4d1b-a4e3-7c91ccffc72d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.531352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc5ad1-376a-4d1b-a4e3-7c91ccffc72d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.531756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc5ad1-376a-4d1b-a4e3-7c91ccffc72d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.531756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 112/219] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:52.532244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.532648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.532929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.554329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:52.555675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:52.560090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.568564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 108/220] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:24:52.569907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.570192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.570460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.591868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:52.593133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:52.647677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 113/221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:52.656492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.679027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 109/222] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:52.775870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4c0f-a6f8-471c-9ae4-b68cdd1ed6e7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.814133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.815064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.815549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.815995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.817354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.818989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.820864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 114/223] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:52.827399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.841453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.930102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.942479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:52.951000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8679-210b-4b5d-9315-3239f6dbfba7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.999137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.999746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.000555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.000830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.001567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=55945bbf4feb4c1e88e91fb760194df4) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:53.001880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.003900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.010540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 110/224] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/role_assignments?user.id=55945bbf4feb4c1e88e91fb760194df4&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.016317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.071890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73699d8f-ed5a-4006-8249-1feeeb02e7b7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.142431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.143118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.143405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.143681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.167260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:53.173865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:53.174812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:53.175657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 115/225] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:53.184265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:53.185422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.233683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac662e3-0c90-4c02-b21f-82c040fe30bc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.280810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.282124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.282453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.282728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.284957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:53.296759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:53.303492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:53.304381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:53.305170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:53.305792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 111/226] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:53.311783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.357026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7910-28c7-47b9-b13e-fcc001079b7a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.425798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.426871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.427683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.428097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.428925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:53.429370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.431433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.442692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 116/227] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.451699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.455857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b141-8328-4209-90fc-0972318d5af5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.545779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:53.559416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.567353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.567353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.567353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.567353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:53.567703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39997-82cf-4826-8afe-4d8a139b05b6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.567801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.567801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.581840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 112/228] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.592432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.610241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:53.614651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.618901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.618901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.618901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.618901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.618901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.620701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 117/229] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.627389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.801794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47cc0-4969-48fb-89a1-cc958dd5ba57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.840837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b459fb-12c3-4876-a76f-5582a41c5206 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.875324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.876545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.876970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.877384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.878928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.880549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.882373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 113/230] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.895490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.900515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.901162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.901439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.901710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.906923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.908844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.910670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 118/231] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:53.916895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.968339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:54.007898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99c588-992b-4854-8393-e80cf434adc5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:54.044936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:54.045941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:54.046423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:54.046919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:54.052681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:54.054405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:54.056301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 114/232] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:54.061985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:54.063067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:54.128711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d799e-fe76-4d91-9c9e-2aeabf391df4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:54.180395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f12c-4b54-411a-81c2-7746a12c6335 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:54.198448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:54.199153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:54.199436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:54.199709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/users/1959380433154690b2da4aa4489eac95/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:54.201928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, user_id=1959380433154690b2da4aa4489eac95, role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:54.204214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6b3a-07cd-43ec-bf48-ac8f71793548 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:54.226604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:54.232891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:54.233608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:54.234104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:54.234441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/users/1959380433154690b2da4aa4489eac95/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:54.236775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, user_id=1959380433154690b2da4aa4489eac95, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:54.238236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c27c-efc9-4d67-8634-db77735f7a1b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:54.324420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 119/233] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:53 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/users/1959380433154690b2da4aa4489eac95/roles/528d204588504e4a8b4c5fe1294470af => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:54.357416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 115/234] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:54 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/users/1959380433154690b2da4aa4489eac95/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:54.885964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e121-617e-4cd2-ba0c-85f4f1fa3392 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:54.886461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e121-617e-4cd2-ba0c-85f4f1fa3392 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:54.886461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e121-617e-4cd2-ba0c-85f4f1fa3392 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:54.887862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 120/235] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:54.893721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07f69-66ec-4f70-88c6-aed0957db0d1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:54.894262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07f69-66ec-4f70-88c6-aed0957db0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:54.894262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07f69-66ec-4f70-88c6-aed0957db0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:54.913338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-02c07f69-66ec-4f70-88c6-aed0957db0d1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:54.914536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02c07f69-66ec-4f70-88c6-aed0957db0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:54.986476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 116/236] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:55.269112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e121-617e-4cd2-ba0c-85f4f1fa3392 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:55.418837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e121-617e-4cd2-ba0c-85f4f1fa3392 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:55.435892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80398-1540-4d4e-b9e5-35ea56ac0826 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.436339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80398-1540-4d4e-b9e5-35ea56ac0826 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.436776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80398-1540-4d4e-b9e5-35ea56ac0826 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.440278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 117/237] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:55.448927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d98218-7ac9-4808-917b-ffa1a522a407 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.449381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d98218-7ac9-4808-917b-ffa1a522a407 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.449850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d98218-7ac9-4808-917b-ffa1a522a407 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.452482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 118/238] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:55.455197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.455644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.456085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.456266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:55.465994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:55.466911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.468669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.468669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.479496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-801c25c0-c3df-492e-8f31-926b3e4e74f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:55.485016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:55.486087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:24:55.486859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:24:55.487918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:55.489224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:55.489361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 121/239] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:55.490678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.491114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.491527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.514298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:55.515875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:55.578862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 119/240] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:55.579887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:55.624461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 122/241] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:55.639764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:55.694428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f6923-094c-4601-b3d9-535be1920dec None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:55.738145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:55.739149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.739806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.740276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.741140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:55.741652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:55.743275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:55.758221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 120/242] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:55.763735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:55.889109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcdcac-bf60-4d46-a740-272241686312 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:55.914677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:55.939999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:55.940731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:55.941018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:55.941294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] PATH_INFO: `/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:55.942850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:55.964443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5e6c97c564c12ad699b1ec1f4bdf3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:55.964443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:55.964443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 123/243] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:55 2022] GET /identity/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:55.977358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.100830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35577706-8961-4cb2-9f15-f0856dab921d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.108833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576a557-d77f-4c90-a0e0-fa04839e5ef0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.119123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.147240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.148103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.148496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.148739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.149022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.149293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.149629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.150167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.150450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.151920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.159177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 121/244] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:56.160357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.207510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.237034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.238753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.296833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d234-e120-4615-ac6c-5f3f8e607c4e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.336924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.337903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.338485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.338965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.352595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:56.359112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:56.360041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:24:56.360914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:56.363676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 122/245] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:56.364859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.375326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 124/246] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 17:24:56.376266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.416370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.479807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.485560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d933a-3fc6-463f-a651-81567b13327e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.511759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb757-f44c-462f-8d3c-446b58dd554b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.527359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.528358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.528838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.529373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.530353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.532646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.554555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.555194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.555475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.560197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.560197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:56.560197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.560197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.567279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 125/247] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:56.573087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.620022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 123/248] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:24:56 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:56.621329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.724366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c259-1427-4e5e-bf08-ea9217577066 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.760396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.769853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f6130-748e-4cfb-9c4b-8f1f38fc25ac None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.775544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.776340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.776687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.777130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.778739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.781976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07393028-5aa2-4b00-93a7-929c602ffad2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.784716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 126/249] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:56.787381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10505-6bc9-4b8c-a3a8-7fba2c69f13e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.787782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10505-6bc9-4b8c-a3a8-7fba2c69f13e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.788164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10505-6bc9-4b8c-a3a8-7fba2c69f13e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.794100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 127/250] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:56.795015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10505-6bc9-4b8c-a3a8-7fba2c69f13e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.800271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:56.816312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.816951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.817884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.817884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] PATH_INFO: `/v3/users/55945bbf4feb4c1e88e91fb760194df4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.819148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] RBAC: Authorizing `identity:get_user(user_id=55945bbf4feb4c1e88e91fb760194df4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.820545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090d8a-9e6b-4be1-8cbc-f227289bee37 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.822218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 124/251] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/users/55945bbf4feb4c1e88e91fb760194df4 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:56.823691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d8c-4b3d-43f1-b83a-bca9e63b765b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.823977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d8c-4b3d-43f1-b83a-bca9e63b765b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.824250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d8c-4b3d-43f1-b83a-bca9e63b765b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.825584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 125/252] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:56.826462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.826741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.827222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.850842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:56.852229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:56.930081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10505-6bc9-4b8c-a3a8-7fba2c69f13e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:56.943048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 126/253] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:56.944193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:56.971394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:56.972582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.972582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.972760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:56.973560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=ffd5e6c97c564c12ad699b1ec1f4bdf3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:56.973875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:56.976356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691392-06f9-4dd1-9f7d-8ef1fb6123cb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:56.982264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 128/254] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/role_assignments?user.id=ffd5e6c97c564c12ad699b1ec1f4bdf3&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:56.983483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:56.983768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:56.984130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.003567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:57.004798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:57.102392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:57.112195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84071-808d-4073-bbe9-0e9ce5bd6f7d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.139447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:57.153983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.156784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.156784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.156784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.157198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 129/255] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:57.157344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:57.159188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:57.161811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 127/256] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:56 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:57.166517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.305654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.327407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ba8a-c1d6-4f20-bc83-168794f6e6c3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.436399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.437683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.438123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.438415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/users/55945bbf4feb4c1e88e91fb760194df4/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.444571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, user_id=55945bbf4feb4c1e88e91fb760194df4, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:57.446229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:57.479051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309eab-ee75-439b-8e98-ee644f4b7df0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.524949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.526023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.526553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.527022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.537714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 130/257] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:24:57 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/users/55945bbf4feb4c1e88e91fb760194df4/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:57.547219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:57.552684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:57.553611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:57.554403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 128/258] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:24:57.559963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.591117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.625465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:57.635431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:57.684118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efaf90-eb83-437a-97d4-34c96bb404f6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.727294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.728310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.728786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.729313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.730360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:57.730972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:57.732799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:57.743453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 131/259] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:57.752393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.767229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c68eb-1742-4d35-a519-3481cb007f63 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.856907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.857488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.857775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.858050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.884087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:24:57.886423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ea63-d405-485d-bf9b-e6da02623e0e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:24:57.888893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:24:57.889767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:24:57.890921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 129/260] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:24:57.900123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.927497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:57.944188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.944937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.945152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.945426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.947845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:57.949365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:57.951468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 132/261] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:57.957899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:58.102059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72e690-0e6b-4078-8f9b-9efd9a793490 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:58.146480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:58.147451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:58.148107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:58.148385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:58.148660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:58.221150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91075652-89e9-4868-8736-38d448f86d3a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:58.239572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:58.255672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:58.257195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:58.287894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:58.288710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:58.289106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:58.289470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:58.290250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:58.290677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:58.292200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:58.302409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 130/262] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:58.307553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:58.460326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 133/263] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 17:24:58.465630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:58.519065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d2be6-b740-45e2-8497-755fa2c36c6b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:58.581386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:58.582314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:58.582600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:58.582872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] PATH_INFO: `/v3/users/1959380433154690b2da4aa4489eac95` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:58.586576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] RBAC: Authorizing `identity:get_user(user_id=1959380433154690b2da4aa4489eac95)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:58.586576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:58.587328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 131/264] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:24:58 2022] GET /identity/v3/users/1959380433154690b2da4aa4489eac95 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:58.594298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:58.611477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:58.619476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:58.641929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7e96-89b1-4e45-8611-4a65dcd50cfa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:58.716376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:58.717350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:58.717849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:58.719015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:58.720449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:58.727104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:58.727251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d3cc-b208-4121-a0aa-753dab7d4b46 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:58.729314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 134/265] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:58 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:58.735618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:58.773223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:58.773843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:58.774121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:58.774391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:58.856071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:58.857594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:58.874695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:58.973538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 132/266] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 17:24:58.979452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:59.009279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55126e91-a88c-47ea-8a0c-0153a283207b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:59.095821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:59.096448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.096732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.097004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.097738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=1959380433154690b2da4aa4489eac95) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:59.098047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:59.098266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3d5f-8890-4565-9f7d-beee61810270 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:59.099513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:59.106174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 135/267] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:58 2022] GET /identity/v3/role_assignments?user.id=1959380433154690b2da4aa4489eac95&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=528d204588504e4a8b4c5fe1294470af => generated 608 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:59.115519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:59.138025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:59.138667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.138952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.139256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.140517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:59.142854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651743-6eb0-44cd-82d6-5a6c18e3177d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:59.144939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 133/268] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:24:58 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:59.150849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:59.189787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:59.297153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98052b-a915-44ee-8119-e7a6e406640a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:59.338343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:59.338965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.339277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.339550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.340290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=1959380433154690b2da4aa4489eac95) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:59.340597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:59.342141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efafd2e-13b0-4c34-a3ba-f0941253f204 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:59.349038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 136/269] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:24:59 2022] GET /identity/v3/role_assignments?user.id=1959380433154690b2da4aa4489eac95&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:59.451102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa420-9099-4c0b-aa2d-21055e3c88fc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.452074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa420-9099-4c0b-aa2d-21055e3c88fc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.452560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa420-9099-4c0b-aa2d-21055e3c88fc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.454756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 134/270] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:59.462141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd8bf-3931-47d0-acb8-6dd0dda27edd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.462462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd8bf-3931-47d0-acb8-6dd0dda27edd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.462691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd8bf-3931-47d0-acb8-6dd0dda27edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.487132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-411fd8bf-3931-47d0-acb8-6dd0dda27edd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:59.488427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-411fd8bf-3931-47d0-acb8-6dd0dda27edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:59.570983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 137/271] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:24:59.868014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa420-9099-4c0b-aa2d-21055e3c88fc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:59.889680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f418-3679-4142-bc18-ff589bfca031 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.890853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f418-3679-4142-bc18-ff589bfca031 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.891399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f418-3679-4142-bc18-ff589bfca031 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.893420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 138/272] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:24:59.899298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf61a-c096-4558-84ed-f2523fb78ca7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.899943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf61a-c096-4558-84ed-f2523fb78ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.900444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf61a-c096-4558-84ed-f2523fb78ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.922458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-677cf61a-c096-4558-84ed-f2523fb78ca7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:59.924143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-677cf61a-c096-4558-84ed-f2523fb78ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:59.934542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:59.996844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa420-9099-4c0b-aa2d-21055e3c88fc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.001434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 139/273] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:00.007372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5e3e-6a2d-4787-a861-3cc56361bbea None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.007372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5e3e-6a2d-4787-a861-3cc56361bbea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.007372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5e3e-6a2d-4787-a861-3cc56361bbea None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.007372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 140/274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:00.012396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.012989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.012989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.032956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:00.034738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:00.038506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.039186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.039470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.039799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.051622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:00.056653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:00.057538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:00.058505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 135/275] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:00.063855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.111919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.133404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 141/276] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:00.177990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206fbd-320f-4d4f-9347-7a90f6484b86 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.213536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.214149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.214430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.214708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.215396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:00.215702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.217086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.226552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 136/277] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:00.232043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.310773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.326382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.340961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d5c5-fbd9-401b-b236-3e694faf97d4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.381256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.382251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.382846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.383367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] PATH_INFO: `/v3/users/c6ee1ba416b04c4ebfefa9cfad853948` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.399157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] RBAC: Authorizing `identity:get_user(user_id=c6ee1ba416b04c4ebfefa9cfad853948)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.401368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.403194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 142/278] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/users/c6ee1ba416b04c4ebfefa9cfad853948 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:00.403914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.439947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f8d0-8586-4d7d-919d-ac577f513fa1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.441765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.477189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.477855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.478193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.478472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.490633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:00.495314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:00.496185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 137/279] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:00.502154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.511300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f2b1-d45c-4cfd-bbe4-a44dccd8e47a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.543461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.549312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.549947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.550225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.550726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.551663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.553148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1eb4d-f386-4f2d-9ddc-a7641f8e413a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.554691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 143/280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:00.555851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeda36-0454-4c6d-8ee9-82616972e219 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.558703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeda36-0454-4c6d-8ee9-82616972e219 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.558703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeda36-0454-4c6d-8ee9-82616972e219 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.558703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 144/281] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:00.558703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeda36-0454-4c6d-8ee9-82616972e219 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.607126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c031-2008-4a3d-9077-4becc24940de None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.641424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.642050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.642325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.642596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.643336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, user.id=c6ee1ba416b04c4ebfefa9cfad853948, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:00.643643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.645095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.649948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 138/282] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/role_assignments?user.id=c6ee1ba416b04c4ebfefa9cfad853948&scope.system=all&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:00.656845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.664510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeda36-0454-4c6d-8ee9-82616972e219 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.691292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.705145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.705784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.706068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.710946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.710946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:00.710946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.710946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2876e-a344-48c0-a8ab-229c6b21eff8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.719023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 145/283] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:00.720399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.720689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.720964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.740009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:00.741240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:00.786885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6dfc-eabb-4c44-876b-a620c8ff6c45 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.810070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:00.821231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 146/284] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:00.827412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.828843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.829088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.829354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.829726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.830476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.832039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.937832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3578-05a0-48bf-b105-a5839e7443c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.956727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 139/285] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:00 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:00.982827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.984049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.984806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.985367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] PATH_INFO: `/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.987108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5e6c97c564c12ad699b1ec1f4bdf3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.988832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.990874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 147/286] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:00.997136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.097013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.098407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.127415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d72e5-067e-44ac-9afe-10314bf2fe0b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.173216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.175194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.175846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.176131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.176403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.177606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.179171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.180830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 140/287] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:01.190876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.238230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd21c2-7530-437e-9ae1-99aaed789359 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.288857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.289661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.289795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.290057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.304804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:01.311876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:01.312851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:01.313649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:01.314652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 148/288] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:01.320384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.323688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eee61-2db6-4f34-a549-278f1d947cf0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.373110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.374129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.374584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.375431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/users/ffd5e6c97c564c12ad699b1ec1f4bdf3/roles/516aaa21a1694adca0d7b42c05db00d6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.380375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, user_id=ffd5e6c97c564c12ad699b1ec1f4bdf3, role_id=516aaa21a1694adca0d7b42c05db00d6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.382401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.450677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33c8ec-8605-42d8-9364-f54f373a3d8b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.458498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 141/289] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:01 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/users/ffd5e6c97c564c12ad699b1ec1f4bdf3/roles/516aaa21a1694adca0d7b42c05db00d6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:01.482351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.499019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.499737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.500083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.500360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.501071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:01.501441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.503045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.512680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 149/290] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:01.519637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.534847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.665652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014310-8bc1-4f6a-9d34-e61d7e9efcc0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.706150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.706813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.707125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.707407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] PATH_INFO: `/v3/users/55945bbf4feb4c1e88e91fb760194df4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.708781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] RBAC: Authorizing `identity:get_user(user_id=55945bbf4feb4c1e88e91fb760194df4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.710359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.712411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 142/291] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:01 2022] GET /identity/v3/users/55945bbf4feb4c1e88e91fb760194df4 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:01.719069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.845809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30231e-07c4-47bc-8481-5e7248b690c7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.896739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.897378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.897663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.897937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.966525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.991479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.993013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:02.109837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 150/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:02.114981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:02.236836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:02.259013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c79eb-6fad-499c-a164-9e7bc1b24bff None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:02.293902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:02.294927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:02.295426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:02.295891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:02.298070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:02.299769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600f402-d97e-445d-9363-34d852ba3bc3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:02.301601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 143/293] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:02 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:02.307872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:02.431848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:02.454738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553bc0-2ec6-4701-bb9a-5be8633e7b28 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:02.504752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:02.505343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:02.505626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:02.505905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:02.506646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=55945bbf4feb4c1e88e91fb760194df4) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:02.506956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:02.508516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96290f4-4b6a-4c39-b07f-f8a2caf76c75 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:02.520566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 151/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:02 2022] GET /identity/v3/role_assignments?user.id=55945bbf4feb4c1e88e91fb760194df4&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:02.926855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fb-7bbb-418b-bd34-daa69f0ccfa2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:02.927420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fb-7bbb-418b-bd34-daa69f0ccfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:02.927420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fb-7bbb-418b-bd34-daa69f0ccfa2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:02.929033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 144/295] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:02.934613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5069-4618-450d-8f8c-d99ac4975cdf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:02.934897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5069-4618-450d-8f8c-d99ac4975cdf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:02.935197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5069-4618-450d-8f8c-d99ac4975cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:02.955238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a65e5069-4618-450d-8f8c-d99ac4975cdf None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:02.956434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a65e5069-4618-450d-8f8c-d99ac4975cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:03.040897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 152/296] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:03.325037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f90fb-7bbb-418b-bd34-daa69f0ccfa2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.406242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e607e-35be-4fb0-8042-9af388e8866a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.406894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e607e-35be-4fb0-8042-9af388e8866a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.407148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e607e-35be-4fb0-8042-9af388e8866a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.408812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 153/297] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:03.414133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30736df-2799-464d-a7ce-e91064dab16c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.414412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30736df-2799-464d-a7ce-e91064dab16c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.414681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30736df-2799-464d-a7ce-e91064dab16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.444091 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f90fb-7bbb-418b-bd34-daa69f0ccfa2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.473815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b30736df-2799-464d-a7ce-e91064dab16c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:03.475415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b30736df-2799-464d-a7ce-e91064dab16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:03.486205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.486868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.487173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.487448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.501664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:03.508110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:03.509038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:03.514952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 145/298] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:03.518182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.529005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:03.577257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 154/299] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:03.601701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2abb5-07fe-45b9-b9af-81827093b3f6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.601987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2abb5-07fe-45b9-b9af-81827093b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.602261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2abb5-07fe-45b9-b9af-81827093b3f6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.607568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 155/300] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:03.609259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.609602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.609880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.622693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:03.628756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:03.630129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:03.647154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b578a-080a-4af9-b992-8f64afd4f3dd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.685585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.686320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.686607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.686923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.688140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:03.688447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.689850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:03.704491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 146/301] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:03.705835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.716782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 156/302] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:03.781475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:03.820985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9dd85-d4da-41be-aee3-47b56913024c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.857392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.858366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.859444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.859940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] PATH_INFO: `/v3/users/c6ee1ba416b04c4ebfefa9cfad853948` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.861294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ee1ba416b04c4ebfefa9cfad853948)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.862960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:03.865077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 147/303] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:03 2022] GET /identity/v3/users/c6ee1ba416b04c4ebfefa9cfad853948 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:03.871137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.877462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.993490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6acda-bb60-4d27-a110-507d9d4e8646 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.993701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea775b-9a09-4650-a738-062b85a839a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.029507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.030142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.030406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.030533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.031323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.031698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.031980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.032255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] PATH_INFO: `/v3/system/users/c6ee1ba416b04c4ebfefa9cfad853948/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.033670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c6ee1ba416b04c4ebfefa9cfad853948, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.034154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.035472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.038927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.042770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fa13db99-8202-4f54-b313-bf7ae259d478 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:04.057844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:04.059208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 148/304] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:04.060135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e473-ef23-4ca4-be10-8dc9bdad7128 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.060848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e473-ef23-4ca4-be10-8dc9bdad7128 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.060848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e473-ef23-4ca4-be10-8dc9bdad7128 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.060848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 149/305] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:04.060848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e473-ef23-4ca4-be10-8dc9bdad7128 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.136231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 157/306] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 17:25:03 2022] PUT /identity/v3/system/users/c6ee1ba416b04c4ebfefa9cfad853948/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:04.137132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.158677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e473-ef23-4ca4-be10-8dc9bdad7128 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.204123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.204781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.205053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.205337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.206543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.208069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eddbc1-1d26-4800-9622-a9e41cd0266c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.209735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 150/307] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:04.211019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.211335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.211612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.231829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:04.233050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:04.262760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d28ed-5cca-4353-bc36-e5c5f2db140f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.303132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.305371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.305992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.306276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.306559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.307271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:04.307582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.308998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.312275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 151/308] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:04.319276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.319390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 158/309] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:04.324592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.406688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.447974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc90705-a1ce-48ab-b9c3-171be00bfe91 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.453251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fff0-3530-415a-866e-cbf224674fed None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.491655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.492295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.492579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.492866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] PATH_INFO: `/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.500220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.501048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.502008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.502423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.503481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.505753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.507422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] RBAC: Authorizing `identity:get_user(user_id=fef11c8ba43a42bb8bd7884b47be2d3b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.508894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.510782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 159/310] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:04.517566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.586805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 152/311] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 17:25:04 2022] POST /identity/v3/groups => generated 229 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:04.587683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.645706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa96d-6714-449f-8a71-afc67cd665c2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.663709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.669289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.687613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.688922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.689206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.689477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.690444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, user.id=fef11c8ba43a42bb8bd7884b47be2d3b, scope.system=all) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:04.690754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.692552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.698202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 160/312] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/role_assignments?user.id=fef11c8ba43a42bb8bd7884b47be2d3b&scope.system=all&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:04.726315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465a88-da59-4401-bbb0-61a5c81f0a50 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.770660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.771765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.772288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.772785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.786946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:04.792862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:04.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:04.794643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:04.795738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 153/313] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:04.801772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.916870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d078-c499-435b-8edf-0875c692f3c2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.957079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.957685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.957961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.958233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.958888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:04.959217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.960607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.970564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 161/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:04.976176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.090714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9470ae-1f0d-4897-977c-32d4bd631c49 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.105992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:05.131873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] PATH_INFO: `/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5e6c97c564c12ad699b1ec1f4bdf3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.138872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 154/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/users/ffd5e6c97c564c12ad699b1ec1f4bdf3 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:05.145585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.201595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:05.259224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2606-e288-4e87-a7c0-0d4abbcea58b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.295219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.295939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.296251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.297116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.376051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.377552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.432208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:05.487753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 162/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:05.490423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.601436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f69a4-832f-4dc3-b2be-9833a025a9ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.637242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.637875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.638159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.638434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.639597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.641990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784799aa-7738-44a4-a369-7e087d4b6623 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.644024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 155/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:05.649740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.759168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39235bf2-4864-40db-bd5a-678cbd0e9c9c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.799611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.800599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.801136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.801601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.802553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, scope.project.id=a09597a1a4bc439d82537a43360a2018, user.id=ffd5e6c97c564c12ad699b1ec1f4bdf3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:05.803074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.804791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160b4ad-4c79-46fb-a19f-eb3afb39842e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.813172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 163/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/role_assignments?user.id=ffd5e6c97c564c12ad699b1ec1f4bdf3&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:06.090583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239f4b4-5454-4743-b3b8-8951d840e18a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.090872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239f4b4-5454-4743-b3b8-8951d840e18a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.091420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239f4b4-5454-4743-b3b8-8951d840e18a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.092670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 156/319] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:06.097947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.098235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.098510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.117364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:06.118564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:06.122339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:06.188493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 164/320] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:06.458879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239f4b4-5454-4743-b3b8-8951d840e18a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.517942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:06.578794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239f4b4-5454-4743-b3b8-8951d840e18a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.615910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.616551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.616834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.617108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.628226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-61be8c31-c26f-4cb3-9d91-eaa1147cab20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:06.633409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:06.634295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:06.635485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:06.636490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 157/321] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:06.640541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.645115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72e53-8805-4776-93f6-3b8f9a950504 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.645407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72e53-8805-4776-93f6-3b8f9a950504 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.645705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72e53-8805-4776-93f6-3b8f9a950504 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.647206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 158/322] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:06.652025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199adae-a500-4826-912a-5cfcb9d9a499 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.652313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199adae-a500-4826-912a-5cfcb9d9a499 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.652590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199adae-a500-4826-912a-5cfcb9d9a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.672048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8199adae-a500-4826-912a-5cfcb9d9a499 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:06.673437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8199adae-a500-4826-912a-5cfcb9d9a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:06.746845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 159/323] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:06.749340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4cff-0781-44a1-a8b8-cac14fc7a530 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.750361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4cff-0781-44a1-a8b8-cac14fc7a530 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.750823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4cff-0781-44a1-a8b8-cac14fc7a530 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.752227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 160/324] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:06.757886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.758169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.758501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.796736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac5d7d-c1b0-425a-b5ce-b24bf249ea3f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.806346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:06.807981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:06.832991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.834047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.834619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.834895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.835592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:06.835895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:06.837404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:06.853242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 165/325] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:06.854133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.857795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:06.862712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:06.917680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 161/326] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:07.001593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a879-9876-4f95-b9ba-13e2414fb995 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.021702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.052480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.053151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.053432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.053740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] PATH_INFO: `/v3/users/c6ee1ba416b04c4ebfefa9cfad853948` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.054925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ee1ba416b04c4ebfefa9cfad853948)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.056497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.058599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 166/327] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:06 2022] GET /identity/v3/users/c6ee1ba416b04c4ebfefa9cfad853948 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:07.066273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.149472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba168d-cf19-4294-8149-4c998c7302bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.152928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.191589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.192225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.192503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.192991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.195741 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472bf5-8b96-4b13-9897-117408b7f3c0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.203624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:07.208327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:07.209237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:07.210025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 162/328] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:07.210715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.232809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.233418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.234315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.234593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.235367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] RBAC: Adding query filter params (role.id=7bafeb1dcbb947f08afdc151d1ed9491, user.id=c6ee1ba416b04c4ebfefa9cfad853948, scope.system=all) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:07.235677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.237116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.243032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.248564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 167/329] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/role_assignments?user.id=c6ee1ba416b04c4ebfefa9cfad853948&scope.system=all&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:07.249432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.336060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea41-5db4-498c-8d60-3c5ac064ecdf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.369823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f499-aebb-4c6a-800b-1d23cdfca0ce None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.375316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.375890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.376213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.376527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.377702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.379296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.381128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 163/330] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:07.386717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.403036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.414892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.415545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.415831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.416108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.416833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:07.417136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.418563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.430287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 168/331] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:07.435890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.499966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.503757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b88f5-0782-4eb5-884f-50f3728dc268 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.539347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.540006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.540298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.540577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.541202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.541605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8540-6fe1-450e-8246-fc3801437e23 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.542636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547daa-34f3-4a4c-9991-d00b1e09dec2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.575258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.575897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.576207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.576493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] PATH_INFO: `/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.578197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] RBAC: Authorizing `identity:get_user(user_id=fef11c8ba43a42bb8bd7884b47be2d3b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.579713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.581323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 169/332] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:07.587787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.640802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 164/333] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 17:25:07 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:07.648220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.694927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb51a2-9e13-4f0a-b340-33a7331e1cfa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.735047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.735769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.736051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.736327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] PATH_INFO: `/v3/system/users/fef11c8ba43a42bb8bd7884b47be2d3b/roles/516aaa21a1694adca0d7b42c05db00d6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.737830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fef11c8ba43a42bb8bd7884b47be2d3b, role_id=516aaa21a1694adca0d7b42c05db00d6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.739258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f3c41-06e0-4888-985c-0d1170ed754e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.806834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 170/334] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 17:25:07 2022] PUT /identity/v3/system/users/fef11c8ba43a42bb8bd7884b47be2d3b/roles/516aaa21a1694adca0d7b42c05db00d6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:09.850359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceaeeb-141a-4fd5-9736-93909bec6435 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:09.850870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceaeeb-141a-4fd5-9736-93909bec6435 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:09.850870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceaeeb-141a-4fd5-9736-93909bec6435 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:09.852467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 165/335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:09.858361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69538-1467-4100-b2cb-81bdcedf2a31 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:09.859600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69538-1467-4100-b2cb-81bdcedf2a31 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:09.859699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69538-1467-4100-b2cb-81bdcedf2a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:09.880569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e8a69538-1467-4100-b2cb-81bdcedf2a31 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:09.881766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8a69538-1467-4100-b2cb-81bdcedf2a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:09.969544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 171/336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:10.177261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2adb-2837-47fb-851a-f5fe0e80391a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.177451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2adb-2837-47fb-851a-f5fe0e80391a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.177734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2adb-2837-47fb-851a-f5fe0e80391a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.179377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 166/337] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:10.184905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.185203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.185489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.212155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:10.213387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.245560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0551e-046e-4498-88ca-1f3536c6c0e0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.245895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0551e-046e-4498-88ca-1f3536c6c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.246128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0551e-046e-4498-88ca-1f3536c6c0e0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.247774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 167/338] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:10.257652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.258030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.258216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.287460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.295454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:10.297377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.328790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 172/339] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:10.391100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 168/340] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:10.620993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.747312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7edf83-2710-4bb5-a771-f01763cbb413 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.780442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.825265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.825920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.826206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.826483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.856076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3b31e74d-a011-4449-874b-661ed8b863c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:10.861150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:10.862461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:10.863287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:10.867529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 173/341] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:10.869636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19c37-a4ad-448f-a4a3-e494c2617d96 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.870080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19c37-a4ad-448f-a4a3-e494c2617d96 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.870502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19c37-a4ad-448f-a4a3-e494c2617d96 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.872104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 174/342] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:10.877260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d19c37-a4ad-448f-a4a3-e494c2617d96 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.940942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538182cf-23ab-4dfa-91e0-1585316b65ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.942913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.983538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.987242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.988098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.988518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.988929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.000932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7663c47e-f87b-4757-a48e-99a4d26a4909 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:11.006574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:11.007672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:11.008488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:11.010556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 169/343] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:11.011997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.012460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.012902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.027603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d19c37-a4ad-448f-a4a3-e494c2617d96 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.033220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:11.034679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:11.070094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.070723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.071237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.071650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.072719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:11.073176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.074873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.086360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 175/344] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:11.087528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.114590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 170/345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:11.115753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.206617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48b29-042f-424f-82a5-5597bac1c804 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.231545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.246766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.247495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.247783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.248155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.260161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:11.266312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:11.267593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:11.268597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:11.269683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.271547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 176/346] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:11.272494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.305142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d737a6-1776-46de-82e7-0c7ea3a6f737 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.365813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.365813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.366094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.366251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.366892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:11.367614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.368657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.387458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 171/347] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:11.388814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.400141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51e41-308d-41e2-bb0d-37ac9f9b87b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.448405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.449311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.449799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.450271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.491441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.531272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.532777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.575119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04789456-0e60-48c2-8804-01abfc48fb97 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.619153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.619679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.619956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.620228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.620891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:11.621195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.622578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.634644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 172/348] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:11.635336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.649081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.652399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 177/349] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:11.653334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.737615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.753307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcf82-8f7c-47fc-a545-08f855489630 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.776923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7215f-0385-4040-aa62-6b3b08324b0c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.796522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.797536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.798105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.798457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.820054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.821032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.821328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.821609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.835490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7843c7a7-c924-41a4-b1ce-8bb26e09664e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:11.840736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:11.841607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 17:25:11.842393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:11.843720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 178/350] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:11.844973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647855-a35d-4c3b-8f3b-dcb509c48426 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.844973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647855-a35d-4c3b-8f3b-dcb509c48426 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.845147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647855-a35d-4c3b-8f3b-dcb509c48426 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.850325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 179/351] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:11.850325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26647855-a35d-4c3b-8f3b-dcb509c48426 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.904348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.906004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.908850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.988294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26647855-a35d-4c3b-8f3b-dcb509c48426 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.019682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.033092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.033805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.034127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.034414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.040586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 173/352] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:12.041444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.128265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.129765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e7856-04c8-4d6c-99b5-816129d5d645 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.162646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bac43-b5bd-4986-a54e-a5d0add49606 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.164345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.201932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.203195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.203700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.204080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.205170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.206626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.208478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 174/353] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.209159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.257859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 180/354] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:12.258908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.259229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.259481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.278190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:12.279438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.300813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.333279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6f52-c947-4621-a1b4-59de63d24cf8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.364434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 181/355] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:12.365527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.378641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.379612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.380380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.380847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.381707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:12.382405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.384122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013921-778f-43fd-b33a-17b79d61433f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.399131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 175/356] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.400287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7d59-19d3-41f4-b727-f9c0b9efce4a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.400616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7d59-19d3-41f4-b727-f9c0b9efce4a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.400896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7d59-19d3-41f4-b727-f9c0b9efce4a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.402270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 176/357] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:12.402823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7d59-19d3-41f4-b727-f9c0b9efce4a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.446658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.503524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c935f-1115-449b-a62e-706235ef8039 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.552635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7d59-19d3-41f4-b727-f9c0b9efce4a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.553058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.553707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.553995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.554453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.555673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.557244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.559198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 182/358] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.559694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.591330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.603679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.604989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.604989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.604989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.614436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.615955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.617734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 177/359] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.627794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.690932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7557a-61a8-4cde-9a0b-fe9ab767e807 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.737172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.738031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.738477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.738813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.740007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.741510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab268cd-601c-4d60-a65f-b6c83bd65c37 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.743263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 183/360] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.745789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.745789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.745789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.748507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.755902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3150-9529-4502-967a-8a416033b92a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.767043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:12.768330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.803909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.804705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.805302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.805597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] PATH_INFO: `/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.807107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] RBAC: Authorizing `identity:get_user(user_id=fef11c8ba43a42bb8bd7884b47be2d3b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.808593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.810240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 178/361] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/users/fef11c8ba43a42bb8bd7884b47be2d3b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.811052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.848488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 184/362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:12.849097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.875495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.940408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e67c6-a500-40a2-ac58-2c2cde4b7443 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.978988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec54c0-5338-42a6-9db7-d8e0b42d86a8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.988676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.989743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.990038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.990315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.992662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.994762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.996880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 179/363] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:12.997652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.024360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.025756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.026108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.026454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.027335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.027700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.029693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.038546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 185/364] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.038546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.049175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.146860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8c7a5-46e6-49c4-ab9e-b4b3eb610bfa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.165482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.189375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcec5-7f62-47ae-8c6c-bcc5d2a5b343 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.205147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.205794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.206081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.206337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.220450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:13.225647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:13.226572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:13.227422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 180/365] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:13.228085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.239013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.239692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.239972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.240246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.241399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.242847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.244838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 186/366] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.245614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.360374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.370120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61d7d-6dbf-46ee-a420-da23657104c0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.373629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da306e87-0176-4969-beb9-3d588b4d360c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.416723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.417313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.417433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.417800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.418142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.418602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.418994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] RBAC: Adding query filter params (role.id=516aaa21a1694adca0d7b42c05db00d6, user.id=fef11c8ba43a42bb8bd7884b47be2d3b, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.419336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.419434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.419865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.420791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.421153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.421411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.422812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.429219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 187/367] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=528d204588504e4a8b4c5fe1294470af => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.429882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.439245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 181/368] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/role_assignments?user.id=fef11c8ba43a42bb8bd7884b47be2d3b&scope.system=all&role.id=516aaa21a1694adca0d7b42c05db00d6 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.440283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.462445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.604735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc711-e910-486d-b0a0-e9777a37dde2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.662417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310543e-cbc1-4f86-82ce-d72ba0297e6b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.671546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.672200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.672478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.672750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.691753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:13.697499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:13.698487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:13.699327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:13.699932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 188/369] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:13.700630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.712964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.714017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.714502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.714986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.716069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.716599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.719125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.729191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 182/370] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.730359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.751172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.802515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.830822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e199bc8-7a20-4080-90f8-fd943ca10945 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.875218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ecbf-b085-49a2-957c-a2ce54bb9fee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.878548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.880166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.881791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.881791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.881791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=a09597a1a4bc439d82537a43360a2018) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.881791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.883308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.889799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 189/371] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.892119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.930476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.931484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.931978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.932508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.933505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:13.934049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.935765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.949006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 183/372] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:13.955650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.050966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006428-aa25-4344-84a8-bd88c2b2d537 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.078922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.118683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d5ed-0acb-4873-8d39-cf43f1853e42 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.123534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.125174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.125788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.126270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.141641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.169361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.169985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.170263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.170545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.239486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.241078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.281556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.283705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.380589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 190/373] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:14.386224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.433284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.453953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.489647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c19b77-963f-403f-99cf-e43fad92afa3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.520731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 184/374] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:14.529594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.532482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.533130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.533409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.533682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.539105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.539105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.543063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 191/375] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:14.544316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.681574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51708ead-1839-4f51-916c-ea38477c45c5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.692194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.720773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.721567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.721948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.722319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.723650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.725156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.726966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 192/376] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:14.732291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bcf9-0bae-4b2d-8ffa-340814349a4b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.733294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.777551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.778485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.778904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.779365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] PATH_INFO: `/v3/projects/8605dc2974624582acfcd7c33837d42e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.781707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] RBAC: Authorizing `identity:get_project(project_id=8605dc2974624582acfcd7c33837d42e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.783570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.785833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 185/377] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/projects/8605dc2974624582acfcd7c33837d42e => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:14.791764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.847266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:14.849258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d578-5686-4096-a6ce-2e3d647d55ab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.885846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.886623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.886994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.887388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.888213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=a09597a1a4bc439d82537a43360a2018) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:14.888619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.891100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.903228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 193/378] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=528d204588504e4a8b4c5fe1294470af => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:14.923114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2d194-5505-4ab4-a84a-a4d351352387 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.964646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.965220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.965500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.965768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] PATH_INFO: `/v3/groups/c1e10757d5cf4ce68d4c01685f06160b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.974746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] RBAC: Authorizing `identity:get_group(group_id=c1e10757d5cf4ce68d4c01685f06160b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.976236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb533e-7e97-43dc-bf22-c560a408e0a7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.978148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 186/379] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/groups/c1e10757d5cf4ce68d4c01685f06160b => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:14.984622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:15.061713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:15.143991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa009b8-8f41-4175-b2bb-994c433bef0b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:15.181337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:15.181951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:15.182230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:15.182502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:15.183327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] RBAC: Adding query filter params (group.id=c1e10757d5cf4ce68d4c01685f06160b, role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=8605dc2974624582acfcd7c33837d42e) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:15.183639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:15.185087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316766-2289-43c0-97e7-11d46f467eef None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:15.195238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 194/380] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/role_assignments?group.id=c1e10757d5cf4ce68d4c01685f06160b&scope.project.id=8605dc2974624582acfcd7c33837d42e&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:15.365519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce00b-6f36-4130-a6d1-56944046ec2f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:15.366482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce00b-6f36-4130-a6d1-56944046ec2f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:15.366974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce00b-6f36-4130-a6d1-56944046ec2f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:15.368804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 187/381] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:15.374362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:15.374643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:15.374914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:15.398504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:15.400073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:15.494311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 195/382] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:15.817499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce00b-6f36-4130-a6d1-56944046ec2f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:15.957992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce00b-6f36-4130-a6d1-56944046ec2f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:15.965280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:15.993717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:15.994350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:15.994682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:15.994959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.005805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d9341041-0481-40fa-8bd4-8af2a2a3fdc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:16.010813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:16.011728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:16.012527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 188/383] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:16.019723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:16.085760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:16.089194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc135e-a491-417c-ba32-67567ed6033d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.089481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc135e-a491-417c-ba32-67567ed6033d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.089756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc135e-a491-417c-ba32-67567ed6033d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.091406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 189/384] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:16.109265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.109589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.109817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.146389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:16.147801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:16.162650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1dbac-9500-434a-809d-6ceea4980223 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:16.199459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:16.200076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.200363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.200642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.201312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:16.201622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:16.204930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:16.213855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 196/385] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:16.219102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:16.313992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 190/386] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:16.375530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:16.388989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc43cc-d6be-4fc5-929b-c49f469b4182 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:16.441129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:16.441767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.442047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.442318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.443476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:16.444922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883016-32dd-4bf6-a658-e0eb084bd9e2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:16.446721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 197/387] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:16 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:16.453124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:16.594348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:16.608101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74901f7-ef75-43f7-a7de-9ff72a1c0d27 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:16.645670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890440f-a74f-4f58-91d2-5b8a64e936ba None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.645879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890440f-a74f-4f58-91d2-5b8a64e936ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.646154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890440f-a74f-4f58-91d2-5b8a64e936ba None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.647816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 198/388] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:16.655784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.656082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.656344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.657767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:16.658408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.658693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.658969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.663923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:16.665503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:16.667268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 191/389] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:16 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:16.674273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:16.692071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:16.693268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:16.789265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9c6f-13ff-4537-b377-75a2ef92a35b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:16.819343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 199/390] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:16.820418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:16.828332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:16.829023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.829277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.829550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/groups/46de0ccf7cd043138dd1cdc9be079653/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:16.837652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, group_id=46de0ccf7cd043138dd1cdc9be079653, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:16.839133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:16.933064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:16.939765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc621cab-8d3d-41c4-a744-10d9528d99d8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:16.958436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 192/391] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 17:25:16 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/groups/46de0ccf7cd043138dd1cdc9be079653/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:16.988112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:16.988819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:16.989148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:16.989512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.003006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:17.008462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:17.009516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:17.010336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 200/392] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:17.016423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.065195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.176975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aca01-2696-4fb3-be89-fb8908e27de8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.215323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.215886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.216168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.216446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.217121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:17.217432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.219005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.228711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 193/393] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:17.234866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.243841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.362488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.376332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544ed6-f543-4c96-8984-9df7ffe3454e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.416445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.417510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.418006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.418596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.430850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:17.436639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:17.437645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:17.438435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:17.441267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 194/394] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:17.447526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.468232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e32e-0e3d-4008-a2a6-ba3cd8f9c043 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.518307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.519015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.519344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.519616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.521584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.523393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7062e-71a4-4922-9555-f728ee33b671 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.525594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 201/395] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:17.526718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd655-bc02-4a1b-b9a4-3bda32b8e0aa None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.527001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd655-bc02-4a1b-b9a4-3bda32b8e0aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.527413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd655-bc02-4a1b-b9a4-3bda32b8e0aa None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.529221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 202/396] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:17.531923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dd655-bc02-4a1b-b9a4-3bda32b8e0aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.566085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b249-ff55-44ba-aba3-401adcb2004c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.590466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.605722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.606853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.607398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.607893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.609095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:17.609635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.611939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab104c-7202-406e-8b76-d8c6cd8ca7e6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.627621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 195/397] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:17.637810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.637810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.637810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.651032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:17.652645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:17.661564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.667184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dd655-bc02-4a1b-b9a4-3bda32b8e0aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.716979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.717932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.718462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.718745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.719954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.721904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.724090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 203/398] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:17.725666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.733744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 196/399] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:17.734931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.884457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.894432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac1a0-8e3f-447d-86dd-36b31d0172ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.895513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eec764-e79a-459d-a6a5-506845657ddd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.941588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.942502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.942790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.943070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.944239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.945808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e2371-8d98-41fb-8ddd-dee79cbd143a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.947717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 204/400] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:17.948061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.948880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb77-5fe6-4512-900f-91408aa821f3 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.949163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb77-5fe6-4512-900f-91408aa821f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.949396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.949503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb77-5fe6-4512-900f-91408aa821f3 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.949975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.950459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/groups/46de0ccf7cd043138dd1cdc9be079653/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.953745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2849850ae3be46b2b33f1d6aefb1f546, group_id=46de0ccf7cd043138dd1cdc9be079653, role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.955438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 205/401] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:17.955806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.957189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.957557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.957899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.979631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:17.980720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:18.019240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.025208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 197/402] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 17:25:17 2022] PUT /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546/groups/46de0ccf7cd043138dd1cdc9be079653/roles/528d204588504e4a8b4c5fe1294470af => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:18.029158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.120753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 206/403] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:18.121977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.241479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.249820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd49b-4059-4f37-927c-3b7f4c85bde2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.260248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8f64-7111-4fdd-b106-987b7889250b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.294495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.295196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.295475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.296314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.297604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:18.299183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:18.302408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 198/404] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:18.308058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.314433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.315426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.315910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.316439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.333108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:18.340023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:18.340908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:18.341719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:18.344614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 207/405] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:18.350514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.391287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.430495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657210e9-0d46-4fd8-bf25-9d2107cf61bd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.476367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.477531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.478751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.479435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/groups/46de0ccf7cd043138dd1cdc9be079653/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.484486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, group_id=46de0ccf7cd043138dd1cdc9be079653, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:18.486803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:18.534170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332aef-635a-4068-a989-fabab8229f39 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.575517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.576127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.576406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.576675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.577900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:18.578231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:18.579782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:18.588628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 208/406] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:18.591899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.611172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 199/407] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 17:25:18 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/groups/46de0ccf7cd043138dd1cdc9be079653/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:18.612656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.616835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.741831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8ecd-39ad-4d6c-b5ac-6ff1187343a5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.786273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.787304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.787782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.788246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.803204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:18.812911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:18.813893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:18.814684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:18.827501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 209/408] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:18.828619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.857256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138f6c-c9f6-42cf-83b0-b84885b6fc6a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.888118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.898161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.902570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.902570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.902570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.902570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:18.902570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:18.904708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 200/409] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:18.912552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.939874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:18.979460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc0be8-5373-464c-897c-a0ccaabb0769 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.037295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.037826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.038108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.038382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.039047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:19.042578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.044003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.057895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0bbc-79d1-4ef5-9329-549216914852 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.070081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 210/410] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:19.076042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.122114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.122853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.123180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.123560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.125299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.126915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438dec-9ac9-4835-bb22-7637d192acbe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.128853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 201/411] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:18 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:19.130015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ff27-c061-48fd-97de-8b5c9f3695f1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.130301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ff27-c061-48fd-97de-8b5c9f3695f1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.130578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ff27-c061-48fd-97de-8b5c9f3695f1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.136000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 202/412] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:19.137247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.137530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.137805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.158705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:19.160024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:19.206100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5be6-46cb-4f80-a3ad-8e85551f5034 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.223733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:19.234545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 203/413] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:19.235546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.243459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.244249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:19.244728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.245072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.245346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] PATH_INFO: `/v3/groups/c1e10757d5cf4ce68d4c01685f06160b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.246480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] RBAC: Authorizing `identity:get_group(group_id=c1e10757d5cf4ce68d4c01685f06160b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.247955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.250514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 211/414] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:19 2022] GET /identity/v3/groups/c1e10757d5cf4ce68d4c01685f06160b => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:19.260044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.353046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80a18-f8b1-41f5-879c-da94398dcc23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.396495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.397163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.397448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.397723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018/groups/46de0ccf7cd043138dd1cdc9be079653/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.401953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09597a1a4bc439d82537a43360a2018, group_id=46de0ccf7cd043138dd1cdc9be079653, role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.404216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.447661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57d824-f9f6-4f06-bd72-c7511ba2e0a9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.485610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.486257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.486544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.486821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] PATH_INFO: `/v3/projects/8605dc2974624582acfcd7c33837d42e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.487995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] RBAC: Authorizing `identity:get_project(project_id=8605dc2974624582acfcd7c33837d42e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.489448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.491640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 212/415] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:19 2022] GET /identity/v3/projects/8605dc2974624582acfcd7c33837d42e => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:19.506617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 204/416] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 17:25:19 2022] PUT /identity/v3/projects/a09597a1a4bc439d82537a43360a2018/groups/46de0ccf7cd043138dd1cdc9be079653/roles/528d204588504e4a8b4c5fe1294470af => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:19.506819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.620172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:19.660105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fe53b-7f7a-4611-bc0d-04ffe69657cc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.664570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.704575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.705509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.705813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.707016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] PATH_INFO: `/v3/projects/8605dc2974624582acfcd7c33837d42e/groups/c1e10757d5cf4ce68d4c01685f06160b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.709017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] RBAC: Authorizing `identity:create_grant(project_id=8605dc2974624582acfcd7c33837d42e, group_id=c1e10757d5cf4ce68d4c01685f06160b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.710491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.733151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:19.789194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 213/417] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 17:25:19 2022] PUT /identity/v3/projects/8605dc2974624582acfcd7c33837d42e/groups/c1e10757d5cf4ce68d4c01685f06160b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:19.791987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f3f32-83a0-42fc-8e95-aadca2e3a7c4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.838951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.839726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.840013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.840288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.857457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:19.863104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:19.864104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:19.864890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 205/418] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:19.871123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.018464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b487f-4380-4246-a421-5b6dbbd3983d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:20.049775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:20.063007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:20.063676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.063955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.064230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.064912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:20.065216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:20.066601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda714c3-7842-4676-987d-b06aaaa619db None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:20.084532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 214/419] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:20.092273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.238774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368b0-f26d-499e-bfb5-058bc305f6ca None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.238953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368b0-f26d-499e-bfb5-058bc305f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.239258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368b0-f26d-499e-bfb5-058bc305f6ca None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.240589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 215/420] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:20.253036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc124-4375-4980-8b25-de2d337955e7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:20.268568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.269070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.269143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.270440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:20.296932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:20.298150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:20.301753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:20.302380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.302663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.302936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.388762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 216/421] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:20.434661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:20.437106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:20.565164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 206/422] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:20.574419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.753857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fde20-bd40-4dd2-b620-a61f9bf509a7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:20.780761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:20.797388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:20.799750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.799750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.799750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.799750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:20.801113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:20.803121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 217/423] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:20 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:20.808461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.816353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.837198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:20.979466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2745453-07bc-4d2f-b393-d6dff17d3a99 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:20.995876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ad04-1816-4387-9422-d1fac08e0eef None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.036825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.037471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.037746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.038017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.050661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:21.056510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:21.057398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:21.058203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:21.062358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 218/424] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:21.065065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.069167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.070059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.070348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.070626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.075789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.077297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.079186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 207/425] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:20 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:21.086448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.124339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.197976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e171-d9a3-474f-9c5f-34c3bdf2a690 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.211262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.235460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b19b-9536-44b9-a26c-117772583768 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.246102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.247589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.248088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.249477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.250806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:21.251341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.253738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e970a-101c-42bd-9ab4-43de9bc6e999 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.270540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 219/426] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:21.270540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6895-f25b-4924-82be-c7a2dd61b751 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.270540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6895-f25b-4924-82be-c7a2dd61b751 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.270540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6895-f25b-4924-82be-c7a2dd61b751 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.270540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 220/427] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:21.275995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6895-f25b-4924-82be-c7a2dd61b751 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.286090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.286701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.286991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.287313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.288047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:21.288362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.290290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219d9cc-2c00-4e9d-a456-b288aeeb65f4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.303178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 208/428] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:21.304918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.306508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.307197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.350171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:21.352735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:21.456083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 209/429] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:21.476535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6895-f25b-4924-82be-c7a2dd61b751 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.489706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.520592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.521731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.522284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.523049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.600358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.601767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.709079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 221/430] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:21.714623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.777874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.790930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.805484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.835861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160e1a6-4a16-45f9-be84-ce273d7a4c44 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.877344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.877902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.878281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.878554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] PATH_INFO: `/v3/projects/2849850ae3be46b2b33f1d6aefb1f546` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.879706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] RBAC: Authorizing `identity:get_project(project_id=2849850ae3be46b2b33f1d6aefb1f546)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.882482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.888764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 210/431] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/projects/2849850ae3be46b2b33f1d6aefb1f546 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:21.890649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.903828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96f534-0798-44a2-a088-2b153d9e7e3b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.953980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.955192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.955694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.956473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.969565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-fda3f1c3-e77d-4d60-a937-f213ef841894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:21.975327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:21.976237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:21.977081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 222/432] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:21.977755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803c8e-a777-45bc-9ac0-6c6177301584 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.978498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803c8e-a777-45bc-9ac0-6c6177301584 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.978498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803c8e-a777-45bc-9ac0-6c6177301584 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.979717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 223/433] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:21.983973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803c8e-a777-45bc-9ac0-6c6177301584 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.020643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66cc7e-276a-4fa3-adf0-17a52b600b37 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.062133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.062747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.063031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.063335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.064585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.066139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf42de-a06d-48d0-b67f-6eab58488a5f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.068246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 211/434] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:22.068972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.069257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.069532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.084613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.089198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:22.090427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:22.096020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.126236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803c8e-a777-45bc-9ac0-6c6177301584 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.160947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.161450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.161738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.162035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.162606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 212/435] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:22.162704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:22.162986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.163486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.164410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e3fe8-97d6-4a4a-bb5f-6971949c04d4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.173762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 224/436] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:22.175313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102893-94b3-45eb-9ef9-41e0926974b0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.175821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102893-94b3-45eb-9ef9-41e0926974b0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.176295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102893-94b3-45eb-9ef9-41e0926974b0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.177980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 225/437] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:22.179387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb102893-94b3-45eb-9ef9-41e0926974b0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.278436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780bf78-ae17-44d9-a7a7-ff4578d396b3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.292266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb102893-94b3-45eb-9ef9-41e0926974b0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.315920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.316534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.316819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.317092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.317821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=2849850ae3be46b2b33f1d6aefb1f546) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:22.318129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.319677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184d6a-b3d0-4433-8214-0bf57fad01f1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.324018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.335141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 213/438] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=2849850ae3be46b2b33f1d6aefb1f546&role.id=528d204588504e4a8b4c5fe1294470af => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:22.335141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.335141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.335141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.340887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.341527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.341875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.342162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.345999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.359986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:22.361387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:22.441418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 214/439] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:22.442999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.444180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.444685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.585821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 226/440] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:22.588914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d8c5-1c5a-4067-af93-f4ee65dd93c5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.593371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.634000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.634630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.635474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.635754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.636025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.638113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.654509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:22.659525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:22.660431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:22.661339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 215/441] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:22.666404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.737318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be0e4-c76a-4fd8-84e6-180f98a8edef None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.777708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.778805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.779104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.779624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.781679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.783498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.785148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 227/442] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:22.785925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.794527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd178672-e35f-4320-910c-feae970f11d6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.830542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.831171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.831453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.831721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.832379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:22.832679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.834049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.842002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 216/443] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:22.843675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.892054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.894758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dabd6-caff-4155-a5ee-9e2552c0f6c3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.901802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.930445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.931073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.931378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.931652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.941835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:22.946567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:22.947761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:22.948584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:22.949185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8af9f-ba5c-4bd2-b811-52ddb8c949fe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.949256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 228/444] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:22.949256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.984744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.985381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.985656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.985930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.987061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.988591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.990120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 217/445] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:22.990880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.052306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739826a4-82ff-4b5b-bde5-310915f142a6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.086268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.086880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.087200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.087474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.095012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4e9a-516a-4b9d-a13a-eaa835cea51f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.116583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.118912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.129827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.130445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.130729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.131009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.132279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:23.132279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.133422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.142871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 218/446] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:23.143739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.159618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.161086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.243869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b7ff-4486-4c64-ab51-f3c3eb5276fa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.263553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 229/447] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:23.264955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.279696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.280999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.281276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.281540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.282263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=7bafeb1dcbb947f08afdc151d1ed9491, scope.project.id=a09597a1a4bc439d82537a43360a2018) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:23.282566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.284059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.290027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 219/448] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=7bafeb1dcbb947f08afdc151d1ed9491 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:23.290847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.343061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.349645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.393981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711088c4-d310-4eea-935f-1d8e43ce966a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.407460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef33b-ddb8-4b1a-b4ea-ec90842a5268 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.436004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156028-6616-4426-a655-0faeab798418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.437273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156028-6616-4426-a655-0faeab798418 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.437664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156028-6616-4426-a655-0faeab798418 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.437910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb156028-6616-4426-a655-0faeab798418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.451781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.452568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.452928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.453227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] PATH_INFO: `/v3/projects/a09597a1a4bc439d82537a43360a2018` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.454937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] RBAC: Authorizing `identity:get_project(project_id=a09597a1a4bc439d82537a43360a2018)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.456031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.457872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 220/449] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/projects/a09597a1a4bc439d82537a43360a2018 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:23.465472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.532206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156028-6616-4426-a655-0faeab798418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.534607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb156028-6616-4426-a655-0faeab798418 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.594983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8089a-99c8-41a9-9ace-c6b79b7eb22d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.615120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.621820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.640485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.641141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.641422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.641704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] PATH_INFO: `/v3/groups/46de0ccf7cd043138dd1cdc9be079653` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.642862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] RBAC: Authorizing `identity:get_group(group_id=46de0ccf7cd043138dd1cdc9be079653)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.644379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.646237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 221/450] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/groups/46de0ccf7cd043138dd1cdc9be079653 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:23.652141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.676520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 230/451] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:23.682674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156028-6616-4426-a655-0faeab798418 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.760868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fc6da-f999-46a3-b399-457d9fb7aa77 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.787310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb156028-6616-4426-a655-0faeab798418 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.795343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.796508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.796785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.797055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.797793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] RBAC: Adding query filter params (group.id=46de0ccf7cd043138dd1cdc9be079653, role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=a09597a1a4bc439d82537a43360a2018) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:23.798110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.799587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.805559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 222/452] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/role_assignments?group.id=46de0ccf7cd043138dd1cdc9be079653&scope.project.id=a09597a1a4bc439d82537a43360a2018&role.id=528d204588504e4a8b4c5fe1294470af => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:23.824209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.824869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.825149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.825421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] PATH_INFO: `/v3/projects/8605dc2974624582acfcd7c33837d42e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.826983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] RBAC: Authorizing `identity:get_project(project_id=8605dc2974624582acfcd7c33837d42e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.828546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.835193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 231/453] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/projects/8605dc2974624582acfcd7c33837d42e => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:23.836284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.892913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:23.947416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2af31a-4778-4cf4-9c70-0b174ea30c5d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.983102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.983744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.984027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.984287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] PATH_INFO: `/v3/groups/c1e10757d5cf4ce68d4c01685f06160b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.985441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] RBAC: Authorizing `identity:get_group(group_id=c1e10757d5cf4ce68d4c01685f06160b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.986901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b738c47-04fd-48b1-9774-93a122a2b17f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.988717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 223/454] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/groups/c1e10757d5cf4ce68d4c01685f06160b => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:23.994405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:24.026763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:24.103350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294d000-e2cf-43e1-b909-485cd4bebd89 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:24.139068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:24.140312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:24.140597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:24.140870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:24.141599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] RBAC: Adding query filter params (group.id=c1e10757d5cf4ce68d4c01685f06160b, role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=8605dc2974624582acfcd7c33837d42e) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:24.141908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:24.143371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be3029-05ef-4030-8360-d495dc75df97 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:24.149437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 232/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/role_assignments?group.id=c1e10757d5cf4ce68d4c01685f06160b&scope.project.id=8605dc2974624582acfcd7c33837d42e&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:26.435207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a033-6d13-4858-9cba-f5f7925d325a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.435744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a033-6d13-4858-9cba-f5f7925d325a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.435744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a033-6d13-4858-9cba-f5f7925d325a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.437953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 224/456] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:26.443487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab790-cae9-4343-bee6-4584795c5f56 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.443951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab790-cae9-4343-bee6-4584795c5f56 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.444053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab790-cae9-4343-bee6-4584795c5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.466399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b6ab790-cae9-4343-bee6-4584795c5f56 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:26.471605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b6ab790-cae9-4343-bee6-4584795c5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:26.565878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 233/457] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:26.799210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdef-fa15-4c02-9e3c-f8d2c8f2f6e3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.799916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdef-fa15-4c02-9e3c-f8d2c8f2f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.800400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdef-fa15-4c02-9e3c-f8d2c8f2f6e3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.802197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 225/458] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:26.809095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf641ce-f4f5-4641-a020-64d2d9bf576d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.809417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf641ce-f4f5-4641-a020-64d2d9bf576d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.809705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf641ce-f4f5-4641-a020-64d2d9bf576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.848087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0bf641ce-f4f5-4641-a020-64d2d9bf576d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:26.850172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0bf641ce-f4f5-4641-a020-64d2d9bf576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:26.884432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:26.961348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 234/459] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:26.983471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cafdef-fa15-4c02-9e3c-f8d2c8f2f6e3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.021806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7667-655d-4df7-8afa-2ce7454be085 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.022132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7667-655d-4df7-8afa-2ce7454be085 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.022377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7667-655d-4df7-8afa-2ce7454be085 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.024024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 235/460] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:27.029468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.030105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.030574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.052149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:27.054292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:27.166973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 236/461] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:27.180707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cafdef-fa15-4c02-9e3c-f8d2c8f2f6e3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.208250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:27.237563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.238565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.239038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.239529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.251762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.253554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:27.275442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:27.276364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:27.277207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:27.277207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.277207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:27.283102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 226/462] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:27.285570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.351744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.390918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:27.428718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ebc6c-a08a-475d-941f-65f892a04750 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.473912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.474537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.474796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.475073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.475748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:27.476098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.477534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.480705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0acf26-6cb5-4dde-bd2b-e4e4645e0c1a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.490686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 237/463] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:27.491631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.522115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.524664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.524664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.524664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.537910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.539599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:27.555352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:27.556290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:27.557166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:27.557166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.557166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:27.557166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 227/464] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:27.557994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.589202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:27.615968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f3b5-6dc2-4877-b9aa-b4469fc15c61 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.654879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.655554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.655845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.656122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.667468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.669112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.671554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:27.674422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167550b5-3140-4e59-ac38-c12614683642 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-507b4c6b-137d-4876-a5aa-c590a1408a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:27.692733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:27.694012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:27.694848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:27.694848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:27.694848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:27.694848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 238/465] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:27.695741 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b1778-d72a-41e6-bbbf-303cd03a291e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.696027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b1778-d72a-41e6-bbbf-303cd03a291e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.696297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b1778-d72a-41e6-bbbf-303cd03a291e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.697918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 239/466] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:27.698484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b1778-d72a-41e6-bbbf-303cd03a291e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.722812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.723467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.723752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.724029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.725134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.726601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.822502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b1778-d72a-41e6-bbbf-303cd03a291e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.827295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 228/467] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:27 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:27.828867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.872343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.872957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.873247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.873516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.874733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:27.875034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.876887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabaa3e-feb6-446e-847c-1e03bf923d7d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.895254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 240/468] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:27.897216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.897723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.898197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.926423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:27.927982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:27.954933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:27.987762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049f5d-f51c-41ac-adae-b7d175ced6a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.005649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:28.028061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 241/469] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:28.028726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.041497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.042135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.042416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.042693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.043401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:28.043712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.045308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.069926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 229/470] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:28.075488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.165274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c516-353b-43f1-9c27-515aafdcd6e2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.189751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23d5a-e91a-4112-a0c5-f6bab2883258 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.204712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.205344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.205722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.206002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.206768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.208429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6a782-3758-48e1-b74b-409424df8451 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.226035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.226649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.226929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.227272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.227975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.229423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.240887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:28.293635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 242/471] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:28 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:28.299234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073fb18-6264-4b69-b85c-1722bc80c665 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.299234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073fb18-6264-4b69-b85c-1722bc80c665 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.299234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073fb18-6264-4b69-b85c-1722bc80c665 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.301308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 243/472] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:28.303359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.303722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.304018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.322391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 230/473] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:28 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:28.335382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:28.336727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:28.338117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.403297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:28.470351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d928f-8233-4ecd-a158-dc3a6b846d03 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.472955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 244/474] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:28.538540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.539907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.540390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.540885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.555309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.556814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:28.575718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:28.576713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:28.577561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:28.577561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:28.577561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:28.577561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 231/475] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:28.585170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.703762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b207d99-78df-420a-91e8-0c300c065d15 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.741054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.742014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.742495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.742965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.743843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:28.744354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.745946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.758936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 245/476] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:28.764803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.812295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.831461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:28.875990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:28.950938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30daefe-3b98-4fe7-acc1-65b4e9cb997a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.996542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca145-eb7c-429c-9bad-31fbc266e1f4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.020208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.020834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.021118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.021392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.022055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.029412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.057001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.057621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.057907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.058184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.058927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.060412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.131303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 232/477] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:28 2022] POST /identity/v3/users => generated 249 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:29.132460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 17:25:29.132460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 17:25:29.132460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [parameters: {'id': 'e042ce86a6cb438d8fc99b2b45f733bf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 17:25:29.132460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Aug 24 17:25:29.149596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:25:29.150566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 17:25:29.151568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 17:25:29.152451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:25:29.153351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:25:29.154232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'id': 'e042ce86a6cb438d8fc99b2b45f733bf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:29.156308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 17:25:29.158310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:29.160342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 246/478] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 17:25:28 2022] POST /identity/v3/roles => generated 144 bytes in 343 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:29.160476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.323555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879e97-ea4e-48cf-8857-bb0af1f47697 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.325203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:29.366617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.367287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.367573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.367916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.379197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bc48d4d6-3eb3-43af-9fc9-8ae3771a6e78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:29.384024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:29.386043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:29.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 233/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:25:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:29.396187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.532396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:29.539913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f78d-9255-4cc3-b76c-22968e07a668 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.580884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.581432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.581711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.581989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.587032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:29.587032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.587032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0667c89-d92e-4014-8af6-26d92cb4ce4a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.598861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 247/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:30.088538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7b84-96b9-4def-88e0-cfefbcdfdf3e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.089229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7b84-96b9-4def-88e0-cfefbcdfdf3e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.089229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7b84-96b9-4def-88e0-cfefbcdfdf3e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.090698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 234/481] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:30.097427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894312-99ce-4dca-b2b4-9a6b26d16ff0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.097708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894312-99ce-4dca-b2b4-9a6b26d16ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.098156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894312-99ce-4dca-b2b4-9a6b26d16ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.124672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1c894312-99ce-4dca-b2b4-9a6b26d16ff0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:30.125893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c894312-99ce-4dca-b2b4-9a6b26d16ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:30.219007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 248/482] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:30.513961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e7b84-96b9-4def-88e0-cfefbcdfdf3e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.656786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e7b84-96b9-4def-88e0-cfefbcdfdf3e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.688683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419ebe-ec5b-47a4-8ce8-b487790c9620 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.689439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419ebe-ec5b-47a4-8ce8-b487790c9620 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.689439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419ebe-ec5b-47a4-8ce8-b487790c9620 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.690801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 249/483] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:30.698092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.698662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.699152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.713815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.713815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.713815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.713815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.735452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:30.736356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:30.737828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:30.743054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:30.743969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:30.744742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:30.747398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 235/484] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:30.753584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.812516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:30.879121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 250/485] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:30.949385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e06d-e68f-44dd-b06f-8714246eba7f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.006390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.007001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.007310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.007589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.008260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:31.008566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.009952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd4366-18ef-4d86-b079-3f9371f812ff None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.022792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 236/486] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:31.028171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.052464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.173141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c4514-9551-479d-9c34-6bc1cea0a6db None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.174109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be513e7-9aef-4dab-ae8f-e2034f1763dd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.174558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be513e7-9aef-4dab-ae8f-e2034f1763dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.174717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be513e7-9aef-4dab-ae8f-e2034f1763dd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.177590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 237/487] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:31.183019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.183335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.183615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.215465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:31.217251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:31.230448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.231117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.231431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.231704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.247247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.247247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:31.266136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:31.267429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:31.268472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:31.268472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:31.268472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:31.270262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 251/488] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:31.275115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.296061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 238/489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:31.297143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.314330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.354603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.415351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4db87-001f-46d4-8ac3-37974973b2b6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.441501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed4f2-a72d-450c-aba3-81610c66e17d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.453886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.454866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.455381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.455854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.456717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:31.457252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.458861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.474372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 239/490] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:31.482099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.548465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.549225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.549433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.549680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.579526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.584145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:31.595109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:31.596110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:31.596917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 252/491] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:31.599593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.604078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd158-e6eb-4886-950b-4cca7858b7e6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.646163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.647003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.647484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.647839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.657593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.659672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:31.677416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:31.679526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:31.681658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 240/492] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:31.687121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.794629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cf63a-7a17-4fa2-a7c0-09ac059f9f07 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.805685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caa33e-9287-4f4a-bd74-fe131c9aff6a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.828340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.837696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.838580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.839025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.839489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.840324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:31.845043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.845043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.852428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 253/493] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:31.853263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.854841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.855660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.856086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.856363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.857138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:31.858911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.861184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6d725-3459-431a-891c-f3c55da65e25 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.862533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 241/494] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d446c2-8512-4f69-b1ad-e7bbf26d98d0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d446c2-8512-4f69-b1ad-e7bbf26d98d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d446c2-8512-4f69-b1ad-e7bbf26d98d0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 242/495] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:31.908277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d446c2-8512-4f69-b1ad-e7bbf26d98d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.984395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d2a7-40a9-4a40-b7d6-a274105fcd6b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.027567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.028165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.028441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.028720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.040936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:32.042862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d446c2-8512-4f69-b1ad-e7bbf26d98d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:32.047382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.048290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 254/496] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.051858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.082704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.083210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.083415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.083651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.098521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.100041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.111323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7ebba418-cb46-43c3-987d-b0960bd57261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:32.117701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.118745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:32.119615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:32.119615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.119615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:32.119615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 243/497] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.120620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.120620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.120620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.140552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:32.141755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:32.172400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd70f-aae3-42d0-9766-295c4082ecad None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.187421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.213589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.214195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.214473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.214744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.215450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 244/498] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:32.216131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.307406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.309539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c323-b24b-46bb-9914-2786eb2fe1ab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.347576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46906a6d-c710-4cee-a22f-7f02d38b79df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.372198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.391217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.391584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.391847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.392126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.392802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:32.393114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.394525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.405858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 245/499] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:32.406724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.437632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 255/500] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:32.439223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f993-2017-47c5-ac38-f571f065f334 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.439513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f993-2017-47c5-ac38-f571f065f334 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.439786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f993-2017-47c5-ac38-f571f065f334 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.441265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 256/501] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:32.441744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f993-2017-47c5-ac38-f571f065f334 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.457869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.529158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ce2d5-52bd-4574-ad88-81865550f406 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.561721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f993-2017-47c5-ac38-f571f065f334 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.566538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.567187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.567470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.567741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.568397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:32.568700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.571588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.585468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 246/502] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:32.586403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.600968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.601610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.601890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.602161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.614780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-113d353d-f16c-4033-8a21-97280cb99c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:32.629405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.630387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:32.631516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:32.631516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.631516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:32.631516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 257/503] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.631862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.631987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.632256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.641369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.657900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:32.659206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:32.698850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.705167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716ef8-ba18-4940-9935-6f7707b3352b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.738880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 258/504] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:32.739690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.744906 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.745627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.745915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.746299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.758090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.759689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:32.775316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.776491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:32.777387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:32.777387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:32.777387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:32.777387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 247/505] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.777387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.877067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eef194-2895-4f10-a25c-6febc1ad2bc3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.900424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4941-65f9-48ea-bb80-cd278a4b0294 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:32.912201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:32.918614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.919032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.919358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.920359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.934389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:32.940429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:32.941146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:32.941359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.942401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:32.948210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:32.948961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:32.948961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:32.949113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 259/506] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.949113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.956348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:32.957980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:32.970665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:32.971874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:32.972942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:32.976346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 248/507] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:32.977235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:32.989082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.066788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b282-e18b-49a4-ad5d-e4c7d2c4d9a7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.086611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a29c-2d44-451e-909f-f587a51eb907 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.111969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.112580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.112864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.113138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.113786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:33.114093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.115559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.120657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.121262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.121540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.121811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.122456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:33.122758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.124223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.127403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 260/508] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:33.128297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.136541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 249/509] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:33.137383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.184501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.213424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.235262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7a5-c013-4007-967e-97292013ac4c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.250399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e938fc-e8ba-4337-ada3-bbdebd2b94b4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.273910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.274537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.274814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.275128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.275814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:33.276116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.277564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.286977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 261/510] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:33.287697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.292023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.292664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.292944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.293213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.293958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:33.294260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.296151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.314840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 250/511] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:33.315860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.405301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc054-f06f-4515-9b8e-00896630bef9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.421219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.430809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae346b-604e-4299-bbed-b3c388278584 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.444788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.445433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.445712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.445986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.460531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.460718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.462048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.472304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.472951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.478304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.478304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:33.480811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:33.481763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:33.483424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:33.483424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:33.483424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:33.483607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.483681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 262/512] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:33.483681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.484460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:33.504843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:33.505853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 251/513] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:33.506751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.604677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a402368-3167-4efd-aa51-da8927f74db3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.620245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97425aa-54cd-4fd2-b48d-790d45f8054b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.644729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.645360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.645638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.645908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.653514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.655676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.661459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.662089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.662367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.662634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:33.667699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:33.668573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:33.669548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 263/514] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:33.670269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.675769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.677357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:33.692362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:33.693493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:33.694327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:33.694327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:33.694327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:33.694327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 252/515] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:33.694745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.701697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.739862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.779158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79893-e368-4957-a07d-5983aa131679 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.804557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8c77-d767-427c-84b8-e563b6f2aa4d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:33.815812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.816424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.816709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.816985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.844283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:33.844893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:33.845177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:33.845456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:33.846107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:33.846412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.847857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.859862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 253/516] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:33.860716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:33.891195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:33.892658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:33.921658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.966350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:33.971870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfba6d0-26ae-4039-b683-ba2c1d34f411 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.005557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 264/517] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:34.006652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.008990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.009602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.009882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.010226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.010950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:34.011280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.012718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.031517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 254/518] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:34.032365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.118256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f832e65-7690-4286-bd26-3e3afd09a831 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.143819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b970b2-c55f-4256-8aa0-af599dd7160c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.145435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.153769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.154446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.154728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.155004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.158296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:34.158296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.158296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.176508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 265/519] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:34.177296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.179897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.180590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.180873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.181148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.181798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:34.182102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.183534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.198256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 255/520] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:34.199210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.223890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.298558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72a66-99f4-4d6a-a81c-6fa1de3f2373 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.321007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee53a4-aeec-44fb-bede-29909fd587f7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.337581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.338186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.338470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.338739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.339411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.340863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.361062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.361690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.361967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.362237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.375346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.376805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:34.391850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:34.392933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:34.393911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:34.393911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:34.393911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:34.393911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 256/521] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:34.393911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.417237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 266/522] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:34 2022] POST /identity/v3/users => generated 247 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:34.418175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.475673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.485994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.535914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff0b5a-612b-4e5a-8565-dec0c9746b20 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.551131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31729c9-07ee-46f5-b81a-34071487bb61 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.585898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.585898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.585898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.585898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.609739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.610877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.611201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.612000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.613041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:34.613041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.614588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.620688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 267/523] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:34.620895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.682100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.683939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.757310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5d05-0f0e-4d50-baa8-14d6bcba3eca None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.765041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.767590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:34.815939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.816620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.816875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.817152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.818915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 257/524] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:34.820037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.833609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.835471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:34.851743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:34.852891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:34.853867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:34.856202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 268/525] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:34.857220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:34.936502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afc-de6d-4844-9995-ec39cbc79905 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.985308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:34.985562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac74fa-ac4a-48c6-adb4-66e0df3e7936 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:34.985973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:34.986172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:34.986445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:34.987121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:34.987424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:34.989154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.007195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 258/526] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:35.007195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.037756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.038601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.039026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.039439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.046068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.055437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.057380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:35.073380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:35.074532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:35.075607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:35.075607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:35.075607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:35.076945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 269/527] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:35.078011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.102086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.141370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2ca-d610-417a-bc8e-08792a747d48 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.181356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.181995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.182277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.182553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.183409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:35.183925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.185513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.207231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 259/528] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:35.208207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.227565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a379e-ce89-4156-abc6-0013ec0e030b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.278657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.279738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.280370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.281052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.290757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.293757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.310481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:35.311975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:35.313056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:35.314136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:35.315893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 270/529] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:35.316843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.337691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9812-9603-452b-9fec-35867c1dca26 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.375230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.375792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.376144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.376493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.377422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:35.377534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.379020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.396583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 260/530] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:35.397668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.427560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.459865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421275-36e6-4a08-a4ea-0f5b9923708b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.505904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.506930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.507390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.507831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.518071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855d50-5cde-4c83-8a83-045c86978fa0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.558672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.559273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.559598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.559875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.560607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:35.560909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.562503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.589066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 261/531] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:35.590133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.600880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.614576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.616458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.706754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.710023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3b86b-7c4b-461e-b793-01767075aa57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.732210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 271/532] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:35.734282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.749128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.750073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.750365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.750645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.763683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.765975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:35.778989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:35.780908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:35.781761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:35.783856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 262/533] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:35.784868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.857230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:35.873521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d7b6-4b71-41d0-87bb-5362a79f8f30 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.897054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3956b-42e9-46f3-a418-a3662fc9f1f4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:35.919713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.920945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.921220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.921496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.922520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=e4e90e02cb2741c6bda1ecd01d92cf6e) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:35.922836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.924515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:35.938811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:35.939301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 272/534] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/role_assignments?user.id=e4e90e02cb2741c6bda1ecd01d92cf6e&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:35.940213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:35.941067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:35.941949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:35.942499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:35.965076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:35.966610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:36.002795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:36.003942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:36.004857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:36.004857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:36.004857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:36.014647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 263/535] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:36.015649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:36.038272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:36.133332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc842-b5f2-47ce-89a3-978fafab44b6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.196139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.197376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.197871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.198341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.199259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:36.199781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.202339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.226834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79d22-4569-4190-9731-d231e7561c1d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.228091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 273/536] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:36.236146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:36.250303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:36.269455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.270314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.270657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.270991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.279148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:36.279148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.279148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.287646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 264/537] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:36.293505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:36.407113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653b5a-4396-4983-abdc-866b7e55f060 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.443074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.443977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.444335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.444683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.452706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.454335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:36.466275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:36.467951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:36.469238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 265/538] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:36.473795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:36.497729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017393-806f-4ebd-a82f-21c831799a2e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.515506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:36.523445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:36.572738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.573365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.573675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.573992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.574738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=070d1f13e4954e999ae30434d4df6d42) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:36.575175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.576789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6d18-ede5-410f-91cf-a5cdfce9868e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.581750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49469f-b7ee-49b5-a6c3-3a8979124648 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.591190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 274/539] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:36 2022] GET /identity/v3/role_assignments?user.id=070d1f13e4954e999ae30434d4df6d42&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:36.624933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0693c8-5f29-4ebb-ae47-a559e18e6ab1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.625249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0693c8-5f29-4ebb-ae47-a559e18e6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.625509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0693c8-5f29-4ebb-ae47-a559e18e6ab1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.627353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 275/540] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:25:36.636071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49bb57-2a8e-48ac-9208-0e6ddf11be95 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.636814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49bb57-2a8e-48ac-9208-0e6ddf11be95 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.639315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49bb57-2a8e-48ac-9208-0e6ddf11be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.668197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ea49bb57-2a8e-48ac-9208-0e6ddf11be95 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:36.669370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea49bb57-2a8e-48ac-9208-0e6ddf11be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:36.684889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.685564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.685850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.686125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.686857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:36.687195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.688741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921c10-b5c9-489c-b3c4-a11f4a332f99 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.709918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 266/541] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:36.712052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b12f9-d1bd-4e0e-8200-8ab2a8c6e535 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.712346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b12f9-d1bd-4e0e-8200-8ab2a8c6e535 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.712662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b12f9-d1bd-4e0e-8200-8ab2a8c6e535 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.714520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 267/542] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:36.715394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b12f9-d1bd-4e0e-8200-8ab2a8c6e535 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:36.789756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 276/543] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:36.791789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.792080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.792512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.815628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:36.817603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:36.834140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:36.840370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b12f9-d1bd-4e0e-8200-8ab2a8c6e535 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:36.910761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:36.913509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:36.914540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:36.915417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:36.917146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=c9a500c664114c47a3f856b8eb2b326b) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:36.918275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:36.920944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:36.934437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 268/544] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:36 2022] GET /identity/v3/role_assignments?user.id=c9a500c664114c47a3f856b8eb2b326b&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:36.947797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 277/545] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:37.175595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.288871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.333686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0e01-ea70-4164-ad69-af5fa601b6c3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:37.346006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:37.440899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092b594-e904-45c5-9b51-67913c4bfc18 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:37.467833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:37.468478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:37.468766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:37.469045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:37.486202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:37.487231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:37.487729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:37.488429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:37.488887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:37.500635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:37.502073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:37.503353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:37.506984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 269/546] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:37.512132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.517426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:37.523875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:37.524986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:37.525925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:37.534927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 278/547] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:37.539415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.561599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:37.696849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e521-fbbb-40cb-8e2c-301096408a11 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:37.703975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:37.729764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a78b3b-0c0f-4c23-ab2b-f8a3692bc0b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:37.772147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:37.773504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:37.774036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:37.774494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:37.775373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:37.775863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:37.777428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:37.793182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 270/548] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:37.797441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.818022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:37.818648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:37.818937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:37.819592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:37.820588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:37.820907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:37.822564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:37.842235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 279/549] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:37.849517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:37.969044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.002911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5e23-17df-4998-b5e6-2d12a8f89b04 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.011317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a989-1bf5-4e27-8124-abdfbead3153 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.054579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.056209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.056511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.057510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.075141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.077168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.077528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.078412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.078883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.083457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:38.093408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:38.094379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:38.095259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:38.095259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:38.095259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:38.095259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 280/550] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:38.095259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.102349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.108748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.110231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:38.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:38.140411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:38.141266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:38.141266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:38.141266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:38.143193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 271/551] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:38.151730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.276734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44f6ea-7df0-4a16-8f66-532a296d63af None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.304619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfbdd-5972-400b-ac6d-8404c0b86e6d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.353945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.354623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.354856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.355161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.355823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:38.356129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.358094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.365884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.366497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.366780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.367054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.367821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:38.368127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.369510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba46fa-334c-47d3-90a2-1437271e2c53 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.378878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.392210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 281/552] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:38.395488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 272/553] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:38.399430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.401193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860441-b38f-40f5-97dc-71a78636f92b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.401485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860441-b38f-40f5-97dc-71a78636f92b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.401770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860441-b38f-40f5-97dc-71a78636f92b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.404845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 273/554] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:38.406858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7860441-b38f-40f5-97dc-71a78636f92b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.471384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.516520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3ddc-9dfc-402c-bb98-b7ee7d73aea8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.524075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7860441-b38f-40f5-97dc-71a78636f92b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.561645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.562249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.562535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.562815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.563058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.563900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.564181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.564457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.571277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.573078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.584392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.585858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d67581ca-2db1-4307-bb95-15558edeb7fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:38.588053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:38.588964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:38.589868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:38.598754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 274/555] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:38.598754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.598754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.598754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:38.612119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:38.613318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:38.614897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:38.617165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 282/556] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:38.618150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.628921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:38.630501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:38.695575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.707419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 275/557] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:38.712058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.761170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cbb66-9b6d-4c8f-ab0e-3cd1580c3b19 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.804011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.826375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16cb4-fb24-459f-90d6-aabd95561155 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.834820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.835436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.835723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.836003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.836823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:38.837134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.838656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.876056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.877093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.877647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.878182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.880294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:38.881792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.883583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.923155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 276/558] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:38.925782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.931545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 283/559] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:38.939154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.002693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.082618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca797df-673d-4c28-933c-d41dfafbc581 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.084426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c84f-e14d-438c-b4c0-7aa3f1e1faed None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.121290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.121509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.121920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.122027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.122213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.122311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.122475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.122573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.136505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.138006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0e03cd8e-c630-433e-84df-5bfa5280817d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:39.154008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:39.155246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:39.156216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:39.156216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:39.156216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:39.156216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 277/560] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:39.157022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0903c3-2f83-4ef8-a5e8-d9ee049a07e7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.157311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0903c3-2f83-4ef8-a5e8-d9ee049a07e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.157588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0903c3-2f83-4ef8-a5e8-d9ee049a07e7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.163191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 278/561] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:39.163191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0903c3-2f83-4ef8-a5e8-d9ee049a07e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.181764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.204568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.206044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2dfbf-4b58-42a6-a292-1a87cf57a765 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.267828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.276569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0903c3-2f83-4ef8-a5e8-d9ee049a07e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.311012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 284/562] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:39.312555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5444-db48-4921-8fd0-b254b1c82804 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.312838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5444-db48-4921-8fd0-b254b1c82804 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.313168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5444-db48-4921-8fd0-b254b1c82804 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.314461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 285/563] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:39.315193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5444-db48-4921-8fd0-b254b1c82804 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.316693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.317517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.317638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.317843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.330472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3ec7b567-8063-45c9-97f8-72219c30495e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:39.335232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:39.336315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:39.337187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 279/564] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:39.337882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.337882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.338002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.358027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:39.359666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:39.405188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.427445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5444-db48-4921-8fd0-b254b1c82804 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.427616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 280/565] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:39.428294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.464555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.465161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.465444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.465717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.466369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:39.467321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.468644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb060f-34ce-49e6-8293-edc4cdf77fa0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.486183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 286/566] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:39.486183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.486183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.486183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.502764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:39.504090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:39.542929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.561658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1097-9334-4dbd-8e17-bc19b95acd77 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.578983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 287/567] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:39.580101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.615060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.615797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.616271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.616525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.628547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.629573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:39.646760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:39.647815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:39.648700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:39.648700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:39.648700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:39.652790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 281/568] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:39.653818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.671719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.708384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b85f-2500-496e-bf66-5d98d1d30c20 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.745789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.746507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.746864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.747248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.748070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:39.748476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.749993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.758965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 288/569] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:39.760069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.781809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6e94-53d6-4402-96a3-0f217672fdf7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.819559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.820209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.820496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.820773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.829183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.830684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.832758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:39.850800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:39.851952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 282/570] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:39.853001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.884636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6b13-25a7-4f87-9b11-71ab973107e6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.914141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.920551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.921240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.921520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.921802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.929193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:39.929193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.929193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.937603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 289/571] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:39.938552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.960183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2897-dfae-4396-98cb-f1813bc1b612 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.996086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.996724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.997003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.997277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.008232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:40.013383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.019718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 283/572] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.020728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.047403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75f1c-d1e3-44d6-8261-a3de85f513e3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.084456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.086511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.087198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.087485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.087764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.100088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.107006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:40.117786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.119066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:40.119978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:40.119978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:40.119978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:40.119978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 290/573] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.120211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.133623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d789e1-3159-40a4-9b06-5817b6c47496 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.165931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.169599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.170815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.171228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.171492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.181658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:40.187204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.188301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 284/574] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.189648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.227807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea651d95-f97e-40e1-bbc5-e2bd20361aaf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.260840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.261441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.261721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.261994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.262681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:40.262990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.264512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.276083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 291/575] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:40.281623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.289113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf621-0fc8-4d62-a02d-7845c59e3df7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.306759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.323783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af962d-d782-4805-be81-db418263eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.324406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af962d-d782-4805-be81-db418263eed9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.324685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af962d-d782-4805-be81-db418263eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.324954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af962d-d782-4805-be81-db418263eed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.331786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af962d-d782-4805-be81-db418263eed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.333232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af962d-d782-4805-be81-db418263eed9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-66af962d-d782-4805-be81-db418263eed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:40.345622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.346541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 285/576] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.347472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af962d-d782-4805-be81-db418263eed9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.382049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b51d-8381-4696-82b7-4d35ebf97df2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.383532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.417073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.417726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.417941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.418213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.418875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:40.419206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.420627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.429261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 292/577] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:40.430253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.454502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af962d-d782-4805-be81-db418263eed9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.487898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.488498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.488779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.489060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.489694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:40.489997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.491419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.503032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 286/578] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:40.503823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.530374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f840b7-9ee1-4d5b-a384-ae479dfd38c2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.546961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.564978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.565588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.565871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.566155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.566829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:40.567162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.568708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.578193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 293/579] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:40.579011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.609202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150964f-0680-4a99-a34c-7edd3b50d87b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.609425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.644888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.645468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.645751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.646154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.660696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=64a58fc0c9a3444a8e5c741204c4dcce, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.662144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.682734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ef474-cb94-44fd-806c-9dbd65a184fe None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.716119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.717424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.717883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.718163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.718900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:40.719248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.720685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.725328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 287/580] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:40 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:40.726253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.733767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 294/581] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:40.734662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.849115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.856993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.866296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd116af-8258-499e-9d16-c31d041ebe94 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.870392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586e55-7738-4667-a445-8fd13eb34656 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.906768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.907359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.907638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.907909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.910208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.910851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.911202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.911480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.916909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.918564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.923976 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.927964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:40.932364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.933397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:40.934332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:40.940040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 295/582] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.940040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:40.941065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:40.941961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:40.943473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:40.943473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:40.943473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:40.943473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 288/583] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:40.944013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.050832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8420a-718d-402b-8336-7edad2b4db38 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.062576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a76a9-f2ac-4c30-bedb-e29c13d04821 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.088277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.089305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.089888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.090167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.097694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.098302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.098582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.098856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.099631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=dd90ca5a48c7411eaee2f3fda54d9dc8) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.099942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.101383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.102687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.104529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.106794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 289/584] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/role_assignments?user.id=dd90ca5a48c7411eaee2f3fda54d9dc8&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.108355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.117032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.122111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:41.132506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:41.133515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:41.134390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:41.134390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:41.134390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:41.136793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 296/585] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:41.138056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.252760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7e63-a2fc-44aa-bac1-58680c4f77ff None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.289745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1fff-77d8-4cf0-913a-458d34fc1a98 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.292577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.293229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.293475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.293749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.294494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.295524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.297271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.317945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 290/586] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.318855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.345648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.346955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.347278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.347740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.348555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.348864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.351137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.369416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 297/587] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.370323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.396157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.448181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0028-9915-45ff-892b-014026db8a25 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.450278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.494464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c778-2df3-4d16-b32d-9704490ec45d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.499956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.500575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.500855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.501166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.501819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.502123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.504118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.522253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 291/588] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.523256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.537471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.538377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.538813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.539258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.552415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.554235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:41.580649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:41.582504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:41.584474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:41.584474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:41.584474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:41.589301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 298/589] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:41.589301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.661923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb934d6-c458-46ea-bd16-916491e33a49 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.688529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.709199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.710230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.710777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.711280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.723854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.725784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.726299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca48f6-bb4c-46be-8fb6-4abebf691c06 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.739284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:41.742920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:41.744064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:41.745197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:41.748269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 292/590] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:41.749663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.769436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.770513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.771051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.771553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.781847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.783733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:41.797188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:41.798207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:41.799192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:41.801890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 299/591] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:41.802904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.892090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747e9d-1706-4f98-ad57-9d52002e56a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.922914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca732-7ce4-48b7-820d-3124bdddec90 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.932332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.933356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.933876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.934454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.935432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.936029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.937921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.953031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 293/592] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.954198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.971722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.972332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.972607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.972891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.973944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.974252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.976009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.999032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 300/593] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:42.000753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.014057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.044240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.083347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c767a-52c4-4e42-b0dc-6ae982a90a31 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.120733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.121369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.121644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.121921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.122650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:42.122985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.124997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.149219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 294/594] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:42.149717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5885-9655-4edb-ac0c-f775151ac545 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.150131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.198102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.199522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.200109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.201433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.210667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.213240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:42.230701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:42.231877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:42.233060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:42.235122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 301/595] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:42.236095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.270229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.273631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c136-2061-440d-a758-10b5d7819091 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.312649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.313365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.313738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.314135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.325402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.327541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:42.345401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:42.346609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:42.347792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:42.347792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:42.347792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:42.348964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 295/596] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:42.349649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.368243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.386507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959cb-26d1-4366-8bd4-0daff713b515 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.425600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.426401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.426817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.427248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.442980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.444752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:42.461351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:42.462980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:42.464168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:42.464168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:42.464168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:42.471003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 302/597] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:42.472078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.479402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1999-7797-4f42-b9b1-ac8a092be6ab None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.530561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.531451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.531883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.532332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.533207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:42.534255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.536130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.555603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 296/598] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:42.556706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.574174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.602554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8dbfb-2c94-4fcb-ac3b-b6311212c29d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.642529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.643346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.643723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.644121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.644836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:42.645256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.646863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.658768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.665310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 303/599] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:42.666778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.692329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cfe5b-8336-441a-a966-d832c53278de None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.736957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.738030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.738460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.738884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.740233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:42.740701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.742590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.757106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 297/600] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:42.758148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.815710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367c4a-1859-49f0-8191-b04d277416d9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.846470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:42.853330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.853996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.854474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.854639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/e4e90e02cb2741c6bda1ecd01d92cf6e/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.873009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=e4e90e02cb2741c6bda1ecd01d92cf6e, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.874926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.877239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71380836-b401-4864-8d9e-c9e1995d4bb9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:42.912640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:42.913276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.913562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.913841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.920755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:42.922207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f75912b6-a822-412d-8f50-2c04d4c63cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:42.933316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:42.934395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:42.935358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 298/601] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:42.936084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607316a-328e-4369-a4bd-5c0ad184bb1b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:42.936263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607316a-328e-4369-a4bd-5c0ad184bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:42.936541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607316a-328e-4369-a4bd-5c0ad184bb1b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:42.942336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 299/602] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:42.942336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607316a-328e-4369-a4bd-5c0ad184bb1b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:42.955288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 304/603] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:42 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/e4e90e02cb2741c6bda1ecd01d92cf6e/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:42.955288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.028062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.095781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607316a-328e-4369-a4bd-5c0ad184bb1b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.098749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46381e7-940b-49fe-a2a3-765dca5bba61 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.131922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.137161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.137837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.138129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.139052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.140428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.141073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.141362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.141642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.142353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:43.142667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:43.144257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a341-0629-491c-a957-836b6e3f66b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:43.147899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:43.149672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:43.170047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 305/604] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:43.171357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb631-16f0-4c3d-a905-bd9a1c043f92 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.171648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb631-16f0-4c3d-a905-bd9a1c043f92 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.171928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb631-16f0-4c3d-a905-bd9a1c043f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-353626a6-e83d-46a4-838a-26bce60afae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:43.174081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:43.174933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:43.175858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:43.177659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 300/605] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:43.179206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f27e-7a3b-49d6-a0c5-ccc4dd53bc96 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.179699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f27e-7a3b-49d6-a0c5-ccc4dd53bc96 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.179979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f27e-7a3b-49d6-a0c5-ccc4dd53bc96 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.181544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 301/606] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:43.182258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34f27e-7a3b-49d6-a0c5-ccc4dd53bc96 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.196631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d15fb631-16f0-4c3d-a905-bd9a1c043f92 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:43.197871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d15fb631-16f0-4c3d-a905-bd9a1c043f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:43.291367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 306/607] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:43.293104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.293464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.293820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.309246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34f27e-7a3b-49d6-a0c5-ccc4dd53bc96 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.316028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:43.317338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:43.353292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.354245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.354705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.355200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/070d1f13e4954e999ae30434d4df6d42/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.367461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.377262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=070d1f13e4954e999ae30434d4df6d42, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:43.379817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:43.392935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 307/608] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:43.393904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.485805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 302/609] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:43 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/070d1f13e4954e999ae30434d4df6d42/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:43.519899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d4a1-a521-419a-99b2-0897374f63f7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.586338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.586976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.587286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.587565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.588754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:43.588754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:43.594775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:43.613988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 308/610] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:43.620034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.677991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.686159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.723494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.756524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9629ea-1a3f-4ee4-8226-f7c854666853 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.797801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.798570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.799146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.799255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/c9a500c664114c47a3f856b8eb2b326b/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.817548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=c9a500c664114c47a3f856b8eb2b326b, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:43.819353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:43.822373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86d36-5ab3-48d2-9a40-51e3cb21170f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:43.859709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:43.860699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:43.861155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:43.861613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:43.872392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:43.877738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:43.878651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:43.879507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:43.881817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 309/611] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:43.882776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.899446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 303/612] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:43 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/c9a500c664114c47a3f856b8eb2b326b/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:43.900814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:43.999694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.006411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9314-aba3-418f-955b-aa1b4f48d350 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.054861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.056046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.056662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.058035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.077985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:44.080036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:44.083581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:44.084547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:44.085393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:44.088290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 310/613] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:44.094887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.108092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e87c-37b9-431f-b727-6e3c12e21047 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.168695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.169583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.169877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.170151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.170822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:44.171145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.172595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.189198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 304/614] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:44.195204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.256998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d8699-6be5-4fba-ad84-6f5c55103598 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.294225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.295447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.295852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.296301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.297770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:44.297913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.299376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.309566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 311/615] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:44.321649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5854d8-6494-4f61-982e-8c9734808e9e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.322921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.349859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.361663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.362549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.362974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.363416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.377539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.379346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:44.395485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:44.396670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:44.397738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:44.397738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:44.397738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:44.400183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 305/616] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:44.407575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.422144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.544581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13af5-888d-416e-abc0-2e69c1049fe8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.595255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.596117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.596544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.596961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.611248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.613156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.632177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741588-9040-4ea5-903c-53650fc3d489 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:44.645219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:44.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:44.647525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:44.647525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:44.647525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:44.655335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 312/617] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:44.656495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.681747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.682813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.683967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.684566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.686356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:44.687903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.689743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.712238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 306/618] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:44.719040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.789087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.831684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da4a8-7442-4175-b158-05d98d7222de None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:44.875827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:44.878464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:44.879024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:44.879998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:44.881045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:44.882347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:44.884516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:44.890687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:44.910647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 313/619] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:44.916590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:44.971109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2a2f-6400-4388-8a12-fa8b35d0bd63 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.027898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0518e-19b1-4c6e-8418-e794a5bc77b9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.056732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.069377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.070475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.070962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.071743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.081288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.081479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.086781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.086781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.086781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.087051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:45.096673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:45.097678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:45.098645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 314/620] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:45.099288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.099914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.104217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:45.114870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:45.115871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:45.116834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 307/621] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:25:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:45.124163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.218979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50e68-9ba0-4374-9d21-b285a440d0f4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.255341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.255876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.256157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.256431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.257171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:45.257480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.258940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6663-a688-41a1-80fe-951ecc932d15 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.278595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 315/622] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:45.284116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc4dd5-fb37-411d-bd1c-948b1759c2b2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.285241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612edc-16a3-40ed-9200-2d7aab47ad8f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.285539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612edc-16a3-40ed-9200-2d7aab47ad8f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.285822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612edc-16a3-40ed-9200-2d7aab47ad8f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.287452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 316/623] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:45.288191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612edc-16a3-40ed-9200-2d7aab47ad8f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.315660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.326756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.332691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2b3de-171e-4963-8d90-616ed28caec2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.338234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.363140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 308/624] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:45.364328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.364620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.364897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.389568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:45.390964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:45.421645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612edc-16a3-40ed-9200-2d7aab47ad8f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.470060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.470720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.471004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.471309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.484195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 309/625] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:45.485404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.485687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.487183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:45.511693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:45.512732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:45.513818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:45.513818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:45.513818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:45.513818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 317/626] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:45.520100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.639386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.647917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de94b0-d707-475b-802b-d8d1493cc30c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.683485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc2973-f54b-4cb6-8b50-f6ab3e3f5e3c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.703719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.704343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.704625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.704900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.705553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:45.705859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.710715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.720134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.732519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 318/627] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:45.744757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.769791 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.770335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.770615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.770891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.860811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.862283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ffa2-b1f0-4fd9-8a9c-5a5d1424353b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.885044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff354f-306b-4b22-8397-d510f00e46ea None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:45.922103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:45.922736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.923014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.923321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.930650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:45.932169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:45.946191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:45.947530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:45.948394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:45.949503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 319/628] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:25:45.950444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:45.970940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 310/629] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c561c-1103-467d-a04f-4aaefe110043 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c561c-1103-467d-a04f-4aaefe110043 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c561c-1103-467d-a04f-4aaefe110043 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 311/630] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:45.979230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c561c-1103-467d-a04f-4aaefe110043 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.002470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.078943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9483-be47-4c16-9fcc-7c4c4eaf1d6d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.092986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c561c-1103-467d-a04f-4aaefe110043 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.119779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.120394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.120678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.120969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.132289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:46.132782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.133393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.133673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.133947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.134690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:46.135017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.136471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b485a33-2d73-4213-9af4-b5b6e9e1b634 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:46.137133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:46.138022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 320/631] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:46.140446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.160367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 312/632] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:46.160367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.160367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.160367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.176553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:46.177755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:46.241226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.259110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 313/633] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:46.259110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.261223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.287961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25686ac2-c177-46bf-9438-56d27648467c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.334631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.335232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.335529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.335815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.348953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.350457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:46.366426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:46.367646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:46.368699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:46.368699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:46.368699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:46.370380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 321/634] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:46.371320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.379759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bea5e-6b78-4409-9005-488721125f48 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.419263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236b59f-3611-4087-b993-cae568079377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.420707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b59f-3611-4087-b993-cae568079377 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.421173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b59f-3611-4087-b993-cae568079377 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.421449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b59f-3611-4087-b993-cae568079377 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.422124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b59f-3611-4087-b993-cae568079377 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:46.422423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b59f-3611-4087-b993-cae568079377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.423830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b59f-3611-4087-b993-cae568079377 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 314/635] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8398-8e98-41cd-8051-bca3786f1958 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8398-8e98-41cd-8051-bca3786f1958 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8398-8e98-41cd-8051-bca3786f1958 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 315/636] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:46.437447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b8398-8e98-41cd-8051-bca3786f1958 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.497590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad7b2-c44e-4dd3-8d48-de9ebe6b871b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.514979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.526085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.535202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.535959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.536232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.536509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/dd90ca5a48c7411eaee2f3fda54d9dc8/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.552458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=dd90ca5a48c7411eaee2f3fda54d9dc8, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.553909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef706d0-7650-45be-8627-8a8d412d6a02 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.557228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b8398-8e98-41cd-8051-bca3786f1958 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.592493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.593103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.593393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.593672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.594343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:46.594652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.596049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.608490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 316/637] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:46.609321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.631265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 322/638] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:25:46 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/dd90ca5a48c7411eaee2f3fda54d9dc8/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:46.632719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.633086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.633440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.652730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:46.654069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:46.734425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 323/639] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:46.736067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0049-e9ee-4285-87f7-1e8601da6b3b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.740077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.770210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.783136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.783136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.783442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.783517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.795854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.797386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:46.815174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:46.816243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:46.817134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:46.817134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:46.817134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:46.817134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 317/640] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:46.817801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.869925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad794fa-4850-44b6-98e8-a9438699ae2a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.881133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.922891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.923562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.924022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.924271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.941781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bfe66-9019-412e-9380-b5dcf4ce9c9e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.954233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:46.969571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:46.971421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:46.973079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 324/641] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:46.976632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.991235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.992331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.992615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.992888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.002900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.004386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:47.021759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:47.023840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 318/642] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:47.026127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.071542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.104508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f95633-1316-43af-85b0-955951cd86c2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.136878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb641ec-5ba8-47f8-a3f1-e17f47fd234c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.145409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.146118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.146527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.146810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.147495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.147807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.149214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.162342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 325/643] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.163217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.180703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.181321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.181607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.181884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.182560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.182866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.184315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.193536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.198321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 319/644] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.199126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.284405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b678d8-c317-4268-80b0-21c42bb13fce None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.318692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.321684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.321849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821ab4-7a6f-4079-aadc-e2a4fbe62d1c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.322310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.322596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.322869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.323780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.324839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.325548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.349209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 326/645] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.349209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.374060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.374700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.374975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.375462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.386125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:47.391406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:47.392364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 320/646] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:47.393446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.446242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.463569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30077-59eb-4713-bf99-3c8dbf12c1e1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.498186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9809-e40e-4ac4-910c-b409fc6f35d8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.503440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.504262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.504716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.505128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.513882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.516145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:47.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:47.530639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 17:25:47.531821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:47.535441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 327/647] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:47.535998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.536316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.536650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.536933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.537208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.550004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.551583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:47.566565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:47.567794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:47.568758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:47.568758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:47.568758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:47.568758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 321/648] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:47.568981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.585596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.690660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c8c82-df8d-4e2e-a27d-7ff056b03f1b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.690934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e852e70-985a-40ab-8d3d-89b26bc2c1b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.735265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.735877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.736156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.736361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.736481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.736929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.737098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.737209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.737362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.737463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.738176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.738511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.738847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.739950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.751425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 328/649] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.751425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.751711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 322/650] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.751711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.769579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.867657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:47.896957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2692-b09e-40dd-b041-52fe1118a863 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.904949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae4119-71b3-4588-9504-2e9abb4c7968 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:47.946514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.947355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.947771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.948191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.948800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.949116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.950277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:47.950557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.951848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:47.952002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:47.952289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:47.953011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:47.954331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:47.956101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.965339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 323/651] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.967433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:47.983107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 329/652] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:47.983107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.076234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.110924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6c73-33a9-4284-800d-8bfbd92a7bf4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.113762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2731e-02ca-445f-8157-092558149db6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.152090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.152965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.153335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.153779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.161867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.162571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.162939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.163400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.163833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.164531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.166634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.177574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:48.184285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:48.185553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:25:48.186781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:48.187539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.187625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 330/653] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:48.188026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:48.204160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:48.205364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:48.206448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:48.206448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:48.206448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:48.213736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 324/654] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:48.213736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.308105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47dabd-db41-4cf4-b7dc-12c6002140c6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.338942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.348018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.348639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.348927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.349203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.359591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952f086-8529-4942-9dac-9f77d2e4dfbe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.398804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.399451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.399736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.400014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.400904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:48.401218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.402692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.427870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 325/655] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:48.428774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.438644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.440538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.478703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.539848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e541d7-4791-4894-85c1-12b8ef5021f9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.580228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 331/656] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:48.586747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.587034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.587728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.587959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.588232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.588885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:48.589189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.590566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.611178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 326/657] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:48.612517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.630808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.724679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ebecc-c19b-4ca9-9818-ad36b64209d0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.734046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9314ad-9e48-40e4-b46e-b0b75be48fb7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.739043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.761284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.761893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.762172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.762444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.801402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.802141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.802419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.802694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.814726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.816219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:48.831963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:48.833150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:48.834220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:48.834220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:48.834220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:48.837657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 327/658] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:48.838369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.841294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.843382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252d97-8bae-43ba-9d95-b1984b318063 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:48.875286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.950014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68decb72-49da-41d1-af17-5ead1f448f40 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.965211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 332/659] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:48.965211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647d3d-a2c7-4d89-ac4e-7ab9ec2a0457 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.965211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647d3d-a2c7-4d89-ac4e-7ab9ec2a0457 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.965211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647d3d-a2c7-4d89-ac4e-7ab9ec2a0457 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.971190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 333/660] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:48.971190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647d3d-a2c7-4d89-ac4e-7ab9ec2a0457 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.986775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.987380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.987663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.987937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.999310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.001109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:49.014058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:49.015060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 17:25:49.016071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:49.018504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 328/661] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:49.023467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.042974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.098392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647d3d-a2c7-4d89-ac4e-7ab9ec2a0457 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.132386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.141512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.144307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.144307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.144307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.144307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:49.144599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.146625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d99cc4-612a-4275-aeea-a29d7c0a95ec None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.164239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 334/662] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:49.165713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.166072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.166416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.172982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa42-79a1-40be-8a95-9b020c03ee57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.196048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:49.197618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:49.220520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.224292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.225198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.226089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.243242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.244967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:49.265432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:49.266465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:49.267407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:49.267407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:49.267407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:49.271268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 329/663] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:49.272041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.285097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 335/664] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:49.286142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.402912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda362a1-dd19-4baf-9b3d-f9ede8790e3a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.443207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.451399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.463605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.464637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.465174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.465657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.474248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.477258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.488633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cc4b7-4caa-4f3f-be15-170dab6c9519 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:49.490092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:49.492946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:49.493883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 336/665] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:49.495661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.526251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.526863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.527171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.527448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.528185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:49.528495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.530929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.554742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 330/666] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:49.555673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.616764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785883-4d59-4481-bfe3-4a71fcaa0ba6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.653252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.653901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.654188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.654465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.655257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:49.655568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.656995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.668475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e538-fe33-475b-b870-6523f1118b11 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.674441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 337/667] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:49.674441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.705362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.715571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.717026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.717762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.718028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.718489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.718720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:49.719025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.720864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.741385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 331/668] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:49.742260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.784724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26eca-75d5-48e3-bab9-ab9b018a02de None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.823314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.823933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.824213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.824484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.855331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4063-bd59-484a-907a-194c4dbb0da9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.890663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.891319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.891598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.891872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.902023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:49.904790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.906255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:49.908598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:49.909710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 332/669] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:49.910553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.953203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:49.959613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.013402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61adb86-1415-46ee-82a2-b19a536cf56d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.014701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 338/670] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:50.019584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.049374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.049933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.050214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.050489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.057564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.059021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2dfaa6c8-998a-443d-bd7e-2e81745c59d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:50.070358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:50.071683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:50.072767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 333/671] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:50.073347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865375-f689-4bea-95b0-304ba4658ef5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.073499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865375-f689-4bea-95b0-304ba4658ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.073771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865375-f689-4bea-95b0-304ba4658ef5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.075057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 334/672] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:50.075911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95865375-f689-4bea-95b0-304ba4658ef5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.123320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef41e0-ff0d-42a1-9510-2c2f74761fdf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.158330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.158937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.159253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.159537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.160288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=e4e90e02cb2741c6bda1ecd01d92cf6e) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.160864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.162300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.168206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 339/673] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/role_assignments?user.id=e4e90e02cb2741c6bda1ecd01d92cf6e&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.168942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.171899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.180250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95865375-f689-4bea-95b0-304ba4658ef5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.188816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.219800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.220432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.220711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.220983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.221664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.221971 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.223431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.232850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 335/674] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.238297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.308180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e8c5-7c54-42eb-86f4-cf288cf2cde9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.349165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.349811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.350092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.350369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.355598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7972-7c87-4de7-9ef3-17fbacdd04ce None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.364321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.365782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-592976d8-e79b-4587-9b98-1137dcb75735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:50.383191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:50.385049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:50.386120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:50.386120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:50.386120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:50.386120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 340/675] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:50.386120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.386452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.386452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.403037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.403037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.403037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.403475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.404369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.404871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.406378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.407533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:50.408877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:50.420525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 336/676] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.421315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.451862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.467559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.491123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 341/677] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:50.491123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.532724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875681d-12a1-4468-a450-94d0596faae3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.572183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.572774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.573058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.573336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.593044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.594999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:50.614161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:50.615373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:50.616290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:50.616290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:50.616290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:50.618255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 337/678] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:50.618561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b87d3-bbce-4b43-a7d6-4ca8b18764b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.619588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.663264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.664751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.665031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.665302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.665987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.666356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.668723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.682155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 342/679] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.683136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.740003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.748914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.774243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7e01-9f6f-4b34-a979-ebeda8debcb1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.805834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac334-481e-4c09-9f07-ced995626ad9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.814676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.815328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.815610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.816101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.816601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=070d1f13e4954e999ae30434d4df6d42) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.816909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.818354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.825010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 338/680] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/role_assignments?user.id=070d1f13e4954e999ae30434d4df6d42&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.825614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.866154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.867049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.867392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.867673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.868855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.869192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.870939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.891265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 343/681] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.892191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.962725 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d84ac-9480-4469-8b24-09a587aa8c54 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.009074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.009959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.010165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.010392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.018769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.020290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:51.034077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:51.035805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 339/682] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:51.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.052716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe0a5-8856-4679-8b40-93d78da08ecd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.053470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.056490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.108810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.109445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.109731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.110004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.126507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:51.133425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:51.134373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:51.135270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 344/683] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:51.136016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.183034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d11b3-599e-435f-a476-db9a8e52e32d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.223338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.224082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.224368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.224641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.234124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.235676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:51.251127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:51.253050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 340/684] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:51.255046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.274226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cdef-e012-4922-b1a0-b618d1b0fcf8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.312346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.313184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.313567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.314008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.314820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:51.315279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.316903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.336310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.341814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 345/685] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:51.341814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.368615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.390322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe41fc-ecb1-4ba5-be93-06e70cd29aad None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.428738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.429598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.430114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.430581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.431473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:51.431973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.433622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.447354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 341/686] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:51.448551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.472923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572701fa-d4c1-40c1-bb47-e5ff865f1aee None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.525225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.525855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.526392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.526677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.527464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:51.527778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.529874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.555018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 346/687] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:51.556691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.576712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01412d-7332-48ba-a9de-8449f8c4c685 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.611350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.620873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.621796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.622347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.623648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.624726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=c9a500c664114c47a3f856b8eb2b326b) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:51.627765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.627765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.634809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 342/688] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/role_assignments?user.id=c9a500c664114c47a3f856b8eb2b326b&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:51.635772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.672568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.714535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca14b-4abf-488e-af8a-704ac79ae82f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.799242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.799891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.800195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.800478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.812404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced03d-1d90-4aaf-ade3-924fb52ffa96 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.830160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.831756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:51.855891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:51.858835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:51.859979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:51.859979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:51.859979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:51.859979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 347/689] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:51.868689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.876844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.877392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.877670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.878112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.944627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.956780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.965279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.992072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0e2d-a1a3-4c2c-9324-5c76193b3858 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.030680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.031352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.031621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.031901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.032559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:52.032858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.034243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.036737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.049096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 348/690] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:52.054662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.071008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 343/691] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:52.078683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.168734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe786455-f675-43d0-97a1-b191d8df1715 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.193835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978224-da3a-46db-bb07-8b12da21b4d4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.206963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.207722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.207862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.208004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.208291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.216376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.217742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:52.231422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:52.232910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:52.233855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 349/692] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:52.238063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.238416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.239236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.239671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.240082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.252742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.254495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:52.272401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:52.273575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:52.274636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:52.274636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:52.274636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:52.284917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 344/693] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:52.290245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.306151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.346981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f4bfd-7319-4d9c-b9de-f44beafffb2c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.384306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.385023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.385210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.385538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.386226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:52.386565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.388608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbbf5e-0524-4781-a6d4-37403d12ccb0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.408686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 350/694] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:52.409989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564d40-811d-4602-9b86-79033c3de230 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.410279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564d40-811d-4602-9b86-79033c3de230 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.410558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564d40-811d-4602-9b86-79033c3de230 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.416648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 351/695] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:52.417469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e564d40-811d-4602-9b86-79033c3de230 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.433369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42a7a-597b-4563-939f-924121cab320 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.473796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.474648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.475138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.475548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.476455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:52.476913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.478509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abebf-fee8-4e9a-bb03-5dd41ba3215a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.494173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 345/696] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:52.495863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.496382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.496902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.518656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.520716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:52.522334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:52.529669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e564d40-811d-4602-9b86-79033c3de230 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.545527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.578939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.580332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.581157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.588981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.611723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 346/697] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:52.613200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.702041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.706991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.802488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ad5b-a85f-4261-a190-90c4aa74fbc0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:52.868825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 352/698] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:52.876065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:52.887240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.893251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:52.904475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:52.907496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:52.907496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:52.907496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:52.916309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:52.917780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:52.929881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:52.930832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:52.931798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 347/699] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:52.932337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.001852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f59f8-0947-4c18-97bf-b55aa589b02a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.041160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.041824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.042116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.042387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.055937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.057413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.064125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111094d-b401-4bc3-968a-1b76d218b4c0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:53.074660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:53.076373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:53.077575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:53.077575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:53.077575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:53.077575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 353/700] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:53.077575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.107490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.108472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.108760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.109381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.123888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.125780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.145688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d2ac4b43-8304-4b64-b4b7-aff9183dbfd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:53.146030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:53.147127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:53.148055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:53.148055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:53.148055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:53.151386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 348/701] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:53.152615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a39e-0e69-4dcb-beb7-24c224f89dc3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.152901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a39e-0e69-4dcb-beb7-24c224f89dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.153182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a39e-0e69-4dcb-beb7-24c224f89dc3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.154672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 349/702] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:53.155461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688a39e-0e69-4dcb-beb7-24c224f89dc3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.197888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eabf9-df97-4162-9155-45e01685b785 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.212885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.238632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.239296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.239593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.239873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.240600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:53.240917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.242384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.255589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 354/703] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:53.256373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.283689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688a39e-0e69-4dcb-beb7-24c224f89dc3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.319831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.320449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.320736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.321012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.321909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:53.322220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.323651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2b331-1c2c-4694-b86c-054084db179e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.336397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 350/704] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:53.337729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.338019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.338296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.363121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:53.364631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:53.378498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac3617-f1a3-4e85-983e-b05add773f78 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.404360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.417442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.418060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.418361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.418615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.419819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:53.420097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.421540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.438383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 355/705] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:53.438383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.451119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 351/706] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:53.451119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.489885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.561917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6059-2ef1-4ecc-aaeb-e2e76b02b46a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.576300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203b66-37c8-43a2-bd21-613dd9c647bf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.619782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.621583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.623207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.623968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.625426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=dd90ca5a48c7411eaee2f3fda54d9dc8) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:53.625534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.626071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.626186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.626403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.626676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.628232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.635100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.636617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.643649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 356/707] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/role_assignments?user.id=dd90ca5a48c7411eaee2f3fda54d9dc8&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:53.644956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:53.649191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:53.650101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:53.650986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:53.655635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 352/708] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:53.656578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.744741 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.801287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:53.808493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65b33-a89f-4fe4-88c2-e0823a6e0b01 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.808957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81db253-0da8-4dc7-8462-8108f1743917 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:53.851409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.851673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:53.852292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.852577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.852687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:53.852849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.853268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:53.853541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:53.853849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.853954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:53.854720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:53.856044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.856223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:53.869767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 353/709] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:53.870621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.939562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 357/710] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:25:53 2022] POST /identity/v3/users => generated 254 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:53.940500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:53.993460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29ff4-96ac-4be2-ab45-45bd2181818e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.034153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.035236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.035734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.036221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.037022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.038684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:54.051686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:54.052849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:25:54.053772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.056827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 354/711] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:54.064468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:54.068918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df6d-eb55-4317-9097-c6fb4424743d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.072277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:54.104959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:54.112213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.113217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.113722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.114195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.115189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:54.115938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.117624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ad1c-e342-4d76-9c84-5e80d2c1309d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.125145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 358/712] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:25:53 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:54.126957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be53e8-bf1f-413d-87ac-294c652b408e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.129543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be53e8-bf1f-413d-87ac-294c652b408e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.129543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be53e8-bf1f-413d-87ac-294c652b408e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.130174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 359/713] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:54.136984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.137637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.138905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.177001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:54.178639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:54.262859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8895d-6316-4f5f-a0bb-0b4364bb5186 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.286080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 360/714] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:54.307325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.308184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.308610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.309027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.309831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:54.310302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.311869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.317155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 355/715] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:25:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:54.323793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:54.437800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:54.442015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc4960-b234-49e9-b76e-1b09574bdac5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.479640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.480677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.481440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.482312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.482959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:54.483481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.484878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.491278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 361/716] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:25:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:54.610542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:54.706490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:54.727715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b422f8-cf76-4b8a-b9bb-5d0bd2412f21 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.767552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.768562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.769067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.769548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] PATH_INFO: `/v3/services/network` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.770321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.771911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:54.782534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:54.783621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:25:54.784518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:54.787351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 356/717] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:54 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:54.793512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:54.974482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a826-fc14-431b-8f15-83468f6e6f08 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:55.021535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:55.027892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:55.028188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:55.028583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:55.029280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:55.029612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:55.031202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890e0a-4c93-4ded-a8b2-ff8210bad3e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:55.036352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 362/718] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:25:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:55.042189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:55.169690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc7f8-09dc-4e1a-9c9c-5be4a323567d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:55.207692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:55.208662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:55.209139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:55.209625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:55.210466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:55.210962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:55.212540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e562-ecd0-491c-95c2-b4a3ce01e0c5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:55.223360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 357/719] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:25:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:56.053114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cfd6-5fe0-4e91-895f-920cee6a2a74 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.053677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cfd6-5fe0-4e91-895f-920cee6a2a74 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.053677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cfd6-5fe0-4e91-895f-920cee6a2a74 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.055344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 363/720] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:56.061517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf325ec-611f-4fe9-ae3c-596bdd1bc7c1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.062006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf325ec-611f-4fe9-ae3c-596bdd1bc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.062096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf325ec-611f-4fe9-ae3c-596bdd1bc7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.092121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9bf325ec-611f-4fe9-ae3c-596bdd1bc7c1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:56.093346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9bf325ec-611f-4fe9-ae3c-596bdd1bc7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:56.097525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:56.181511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 358/721] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:56.469030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1cd2-2b27-45f5-bd76-f1f95466c14f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.469204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1cd2-2b27-45f5-bd76-f1f95466c14f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.469485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1cd2-2b27-45f5-bd76-f1f95466c14f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.471062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 364/722] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:56.476623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8851-3971-4e76-87c7-c7f428434d75 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.476912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8851-3971-4e76-87c7-c7f428434d75 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.477187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8851-3971-4e76-87c7-c7f428434d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.496445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0dbb8851-3971-4e76-87c7-c7f428434d75 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:56.498337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dbb8851-3971-4e76-87c7-c7f428434d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:56.576442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 359/723] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 17:25:56.658929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e1cd2-2b27-45f5-bd76-f1f95466c14f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:56.697320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:56.792728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e1cd2-2b27-45f5-bd76-f1f95466c14f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:56.837562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:56.838218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.838415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953871-87f7-4a90-b259-4684054fdb3f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.838537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.838730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953871-87f7-4a90-b259-4684054fdb3f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.838829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.838974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953871-87f7-4a90-b259-4684054fdb3f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.840705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 360/724] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:56.847188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:56.847472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:56.847744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:56.854013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:56.859454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:56.860417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:56.861516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 365/725] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:56.873161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:56.880901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:56.882082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:56.985376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:56.991838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 361/726] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:56.992850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.036172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.064673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd057-b6f9-4da4-88b0-24576567bd74 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.130352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20f5aa-cceb-4fd9-a87d-a6d3bdc3eb26 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.140344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.141745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.142244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.143108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.144280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:57.144773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.147162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb7e3-50c6-4cdc-81b2-cdbb8a164e97 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.160517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 366/727] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:25:57.162863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d082ff-1d5d-48bb-8112-247368bf7f95 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.163515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d082ff-1d5d-48bb-8112-247368bf7f95 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.164080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d082ff-1d5d-48bb-8112-247368bf7f95 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.170397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 367/728] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:57.170397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d082ff-1d5d-48bb-8112-247368bf7f95 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.173255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.175217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.175711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.176205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.191984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-390924c9-0e1c-4323-9579-8c69c1e96407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:57.198816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:57.199818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:25:57.200693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:57.207827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 362/729] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:57.207827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.208052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.208295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.227864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:57.229125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:57.292553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.305286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d082ff-1d5d-48bb-8112-247368bf7f95 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.305483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 363/730] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:57.306182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.352173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.352722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.353005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.353283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.368893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.372266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.383285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:57.390787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:57.392102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:57.393476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:57.393476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:57.393476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:57.393476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 368/731] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:57.393476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.440159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07688a-f811-4207-8c39-c6f517605879 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.487448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.488192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.488545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.488932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.489674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:57.490050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.491562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.506267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 364/732] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:57.507329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.523119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8436a-c16a-49ff-afec-76ac9667dba4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.567922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.577313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.578419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.579227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.586627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.599888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:25:57.605145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:57.606260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:25:57.608002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:57.611797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 369/733] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:57.612675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.631480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18f9f-139d-422e-87b6-c80faed42fc2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.670001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.670622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.670905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.671215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.671857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:57.672161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.673532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.676004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.686168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 365/734] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:57.687189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.720714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969e6d-582a-4cb0-880b-e6c5a3d0fd77 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.754019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420b21-2932-4621-8400-107657163800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.754649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420b21-2932-4621-8400-107657163800 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.754931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420b21-2932-4621-8400-107657163800 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.755242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420b21-2932-4621-8400-107657163800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.766339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420b21-2932-4621-8400-107657163800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.767816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420b21-2932-4621-8400-107657163800 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3e420b21-2932-4621-8400-107657163800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:57.783111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:57.784093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:57.784988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:57.784988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:57.784988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:57.784988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 370/735] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:57.787946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420b21-2932-4621-8400-107657163800 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.788517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f051f-f8db-4081-9e0a-84559bb38ce2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.802431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.824809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.826027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.826304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.826579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.827257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.828651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe64aa2-de28-4803-b338-a8ba7a70c059 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.889454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420b21-2932-4621-8400-107657163800 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:57.901862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:57.922543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:57.923199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.923460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.923731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.924393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:57.928493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:57.928493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:57.928678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 366/736] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:25:57 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:57.928678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20ab-b21f-4c2a-adfd-51b19e43f637 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:57.928678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20ab-b21f-4c2a-adfd-51b19e43f637 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:57.928678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20ab-b21f-4c2a-adfd-51b19e43f637 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:57.933708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 367/737] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:57.935314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20ab-b21f-4c2a-adfd-51b19e43f637 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:57.941910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 371/738] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:57.941910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.056689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec692f26-df03-4a5b-b854-008f83becd43 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.064467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20ab-b21f-4c2a-adfd-51b19e43f637 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.104283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87741908-a964-4eff-b411-299b47616d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.104902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741908-a964-4eff-b411-299b47616d05 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.105184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741908-a964-4eff-b411-299b47616d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.105460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741908-a964-4eff-b411-299b47616d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.106118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87741908-a964-4eff-b411-299b47616d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:58.106505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87741908-a964-4eff-b411-299b47616d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.108408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.108543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87741908-a964-4eff-b411-299b47616d05 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.109054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.109337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.109613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.120056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.120770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 372/739] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:58.126406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.126571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.126571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.126571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:58.139068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:58.140460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 368/740] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:58.141443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.145920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:58.147163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:58.173306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.177795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.221641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 373/741] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:25:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 17:25:58.227324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.257574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b0d6-9fc5-4d33-af55-bf1b39da8810 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.298298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.299359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.299881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.300249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.312075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.313662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:58.330252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:58.331287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:58.332191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:58.332191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:58.332191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:58.336521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 369/742] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:58.337484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.354489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895ac0d-53df-4f3e-a813-1f4a5b0200f7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.406252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.407939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.408410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.409142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.420855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.422569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.432602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:58.440287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:58.447477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 374/743] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:58.448634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.461368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c5f9a-67ae-4033-9797-1a50d814e451 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.483986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.501791 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.502642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.503124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.503549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.504426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:58.504883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.506643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.527133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 370/744] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:58.528135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.578073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df198c9d-03d1-4e27-a153-cf22560ecf3d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.618263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.618878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.619191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.619472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.620121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:58.620429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.621801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.638162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 375/745] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:58.638162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.655151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c727b0-003f-4eb3-9159-fe52b58b233e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.695341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.695874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.696414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.696690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.697415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:58.697720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.699185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.707509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.723602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 371/746] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:58.724331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.729020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.748157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a747-e222-4c83-9f87-dc0d3f012979 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.787524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.788169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.788525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:58.788731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:58.868268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:58.869737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:58.952128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104890-44ea-4a37-acce-a277c38f2bb6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:58.966286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:58.988899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 376/747] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 17:25:58.988899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:58.998779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:58.999552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:58.999835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.000109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.000926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.003028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.080754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 372/748] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:25:58 2022] POST /identity/v3/services => generated 240 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:59.081953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.107938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ea84-cbaa-4712-9181-fff2e8d4aa0d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.173279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.177118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.177951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.178297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.178691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.187422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.189132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:25:59.202820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:59.210124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 377/749] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:25:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:59.211191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.250810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e815f0-67a9-4024-88de-d2226da9a242 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.261583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.296598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.297411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.299228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.299510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.312501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.314025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.332868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839a02-b06e-4f90-87ff-454454eafbb7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:59.333171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:59.334108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:59.335676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:59.335676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:59.335676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:59.335676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 373/750] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:59.335676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.386046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.387121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.387670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.388383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.403931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.406532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:25:59.429363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:59.430377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:25:59.431721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:25:59.431721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:25:59.431721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:25:59.435101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 378/751] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:59.436439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.465490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2681fe-4309-4d51-b5db-bdef5e66c4b6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.478737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.512396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.514173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.514659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.515198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.516144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:59.516687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.518431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.538379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 374/752] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:59.539719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.549712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.558440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797d90-d5ee-42e0-97a5-fcaf99be4f81 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.597906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.598525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.598810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.599104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.599794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:59.600105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.601487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.614081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 379/753] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:59.615025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.668104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b882e7-b197-4a82-8049-638265f076b0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.708684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.709317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.709626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.709906 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.710659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:59.710972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.712375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.722916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bf77f-e0de-4e65-bf33-fa93165023dc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.725763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 375/754] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:59.726660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.757536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.759641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.760334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.760682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.761024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.784839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:59.834666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.836045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1461d-fadc-4100-8583-461110613ed7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.837766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee2ed7-7f9b-44a4-afa6-ef91e5554187 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.877125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.878008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.878439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.878966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.886579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.889115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:25:59.901418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:25:59.902531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:25:59.904369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:25:59.905509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 376/755] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:25:59.906217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.946740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 380/756] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:25:59.949036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f72e-8937-45ea-b3c9-1ebcc1ef0482 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.949541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f72e-8937-45ea-b3c9-1ebcc1ef0482 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.951287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f72e-8937-45ea-b3c9-1ebcc1ef0482 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.953538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 381/757] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:25:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:25:59.954559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578f72e-8937-45ea-b3c9-1ebcc1ef0482 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.001386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.013191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.013322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8532d-9110-4657-aca3-e9f2c4251e81 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.048706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.049334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.049616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.049890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.057044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.058506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.066047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578f72e-8937-45ea-b3c9-1ebcc1ef0482 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:00.070002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:00.070870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 377/758] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:00.077707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.110055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.110940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.111255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.111536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.112465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:00.112779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.115072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5586-5fc0-4b21-9729-639d3bf8d481 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.127396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 382/759] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:00.128657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c652e7-8067-4074-8155-41a422072b7a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.128944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c652e7-8067-4074-8155-41a422072b7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.129216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c652e7-8067-4074-8155-41a422072b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.148338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-57c652e7-8067-4074-8155-41a422072b7a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:00.149542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57c652e7-8067-4074-8155-41a422072b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:00.185705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e10b45-b534-4b0f-883b-92c057fd1446 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.225031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.225662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.226167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.226272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 383/760] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:00.226351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.235962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c652e7-8067-4074-8155-41a422072b7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.238513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.241095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.251148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:00.264641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:00.265740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:00.266780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:00.266780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:00.266780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:00.266780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 378/761] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:00.271103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.288728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.352136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c652e7-8067-4074-8155-41a422072b7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.391411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.392128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.392474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.392822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.393612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:00.394077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.395760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.405776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2648-4d27-af87-02864486117b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.410020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 384/762] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:00.410933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.443729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.444950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.444950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.445369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.447948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=64a58fc0c9a3444a8e5c741204c4dcce, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.449190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.517658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 379/763] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:00 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:00.518824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.534785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664a3e-cf47-437f-984b-094564e15318 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.537645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.592586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.593223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.593501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.593773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.594430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:00.594732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.596214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.602593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.611704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 385/764] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:00.612678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.664002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01d87-3753-4901-8754-f7decc4d8f79 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.711000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.711649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.711918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.712184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.712900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=dd90ca5a48c7411eaee2f3fda54d9dc8) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:00.713206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.714629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.724300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 380/765] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/role_assignments?user.id=dd90ca5a48c7411eaee2f3fda54d9dc8&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:00.725222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.734341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dc4e-3a06-40a7-bea2-4e82e89c2bff None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.799352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.799923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.800201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.800468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.801062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.802455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:00.825652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:00.826704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:00.827568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:00.828887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 386/766] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:00.836624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:00.894906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.915261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b4de-5335-49a3-b18f-208069424f03 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.941688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:00.963241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:00.963985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:00.964269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:00.964637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:00.974357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9d47e-9016-42a9-993f-b2b64f68f859 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:00.983812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:00.985409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:01.004719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:01.005654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:01.006544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:01.011235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 381/767] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:01.012082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.019820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.020440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.020787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.021061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.021695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:01.021997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.023394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.037915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 387/768] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:26:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:01.045596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.158199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118222df-2e47-44a4-ad66-74ea7b5c9148 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.203999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.205473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.205981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.206999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.208175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:01.208802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.210439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf973a-c4e0-4cc9-97c6-c2fb69fa9143 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.211207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:01.223494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af159-2eb6-47aa-8bbb-2585e19fd2cc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.228969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 382/769] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:01.230505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e3ca-40fb-4916-94cb-3235437a4bdd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.230990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e3ca-40fb-4916-94cb-3235437a4bdd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.231538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e3ca-40fb-4916-94cb-3235437a4bdd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.233745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 383/770] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:01.235168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6e3ca-40fb-4916-94cb-3235437a4bdd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.270170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.270943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.271272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.271549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.272523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:01.272835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.274487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5279-8a3a-41d5-875e-e6d32d1f5f7a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.285856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 388/771] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:01.285856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.285856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.285856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.298850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:01.308408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:01.312731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:01.359480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6e3ca-40fb-4916-94cb-3235437a4bdd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.393255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 389/772] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:01.394047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.398704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.400455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.400944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.401448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.402364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=89ab0b719a1948b583a8202886902a4a) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:01.402895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.405366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.412507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 384/773] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/role_assignments?user.id=89ab0b719a1948b583a8202886902a4a&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:01.548683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:01.581028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db98c-f163-40bc-8a51-e53dcf4b2130 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.728821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.762296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.763360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.763845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.764316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.765251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] RBAC: Adding query filter params (interface=public, service_id=5ffc78295e2b48c2a28b44cc2a7ecef8, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:01.765775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.767380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.776460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 390/774] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/endpoints?service_id=5ffc78295e2b48c2a28b44cc2a7ecef8&interface=public®ion_id=RegionOne => generated 194 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:01.785917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:01.911034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94043571-bd81-41e5-ac17-dca137527dc5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.920037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:01.954594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:01.958325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:01.958830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:01.960280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] PATH_INFO: `/v3/services/network` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:01.962585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:01.964904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:01.978498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:01.979848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:01.980733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:01.986568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3c6b-60dc-4f7f-ae75-b71a77281095 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:01.990159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 385/775] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/services/network => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:01.995651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:02.050487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:02.051667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:02.052286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:02.052759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:02.053566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:02.055238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:02.064035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 391/776] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:02.158182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2528b-f455-47c6-ad33-7161d809ea49 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:02.211734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:02.213167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:02.213673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:02.214171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:02.215009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] RBAC: Adding query filter params (name=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:02.215542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:02.217251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:02.228358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 386/777] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:02.234264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:02.252118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:02.348993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25fcd6-b7a4-40ad-ba78-f6473afdf599 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:02.390969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:02.391629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:02.391913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:02.392187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:02.392833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] RBAC: Adding query filter params (type=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:02.393138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:02.394501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:02.400191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 392/778] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:02.406916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:02.454874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:02.538220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ddf1-3d19-4ed9-b645-8f6c4c1d5bbe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:02.583405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:02.584027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:02.584307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:02.584584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:02.585283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] RBAC: Adding query filter params (interface=public, service_id=8c87ffe6f9904e6caf9cefb16392ad45, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:02.585590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:02.586961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5200-c618-4827-b10c-061f9f8549d8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:02.598015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 387/779] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:02 2022] GET /identity/v3/endpoints?service_id=8c87ffe6f9904e6caf9cefb16392ad45&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:02.603662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:02.713102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:02.740259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba5c-da7c-47af-b266-60bfea9da854 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:02.794410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:02.794923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:02.795234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:02.795513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:02.796125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:02.797492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f90a2-9ce3-4e75-a634-078892a2d711 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:02.807897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 393/780] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:02 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:03.005385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20c82a-c149-40e9-9321-38edc823290d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.005760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20c82a-c149-40e9-9321-38edc823290d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.006014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20c82a-c149-40e9-9321-38edc823290d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.007850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 388/781] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:03.013287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.013573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.013851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.019421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a07-39e7-4977-98ee-6f9d9a47a61f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.020012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a07-39e7-4977-98ee-6f9d9a47a61f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.020578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a07-39e7-4977-98ee-6f9d9a47a61f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.022367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 389/782] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:03.028025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.028651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.029152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.042024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:03.043273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:03.048890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:03.050311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:03.128289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 394/783] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:03.138358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 390/784] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:03.402394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.475805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.498036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:03.525811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c36a-ba2b-415d-ba83-1c2045479cdd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.544090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:03.567834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.568717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.569137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.569573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.595119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:03.595915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:03.597003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:03.597862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:03.598752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 395/785] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:03.604352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.675008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64067586-e0fc-4387-887e-fea0b02810b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.708459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89254-78d6-4908-a93b-46f2fc0209f1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.740608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:03.745973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.746695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.746925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.747204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.747452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.747694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.747882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.748128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.748793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:03.749129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:03.750561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:03.759221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 396/786] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:03.765633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.780197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:03.784865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:03.787225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:03.789217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 391/787] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:03.795691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.882350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b149d-6664-4e8f-b797-9991797bb72a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.917915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.918546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.919406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.919734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.930856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:03.932284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:03.949168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:03.952369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:03.954377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:03.954377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:03.954377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:03.954377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 397/788] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:03.957592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.977129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:03.994399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62560de7-8fbf-4be9-9c82-74aed13be5e6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.058385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.058996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.059815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.060089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.060749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:04.061052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.062419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96141-57e9-405a-8cf7-f79f08132445 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.063198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.079160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 392/789] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:04.081960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5301b8-1c51-4133-aae9-156ca75c8037 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.082249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5301b8-1c51-4133-aae9-156ca75c8037 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.082525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5301b8-1c51-4133-aae9-156ca75c8037 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.084078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 393/790] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:04.084778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5301b8-1c51-4133-aae9-156ca75c8037 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.129509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4b6d2-683a-4ecd-ab30-15f2b8b43a54 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.171099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.171472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.171802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.172082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.172725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:04.173027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.174669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7050e7c-5738-44fa-9526-40c71b747ce5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.192661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 398/791] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:04.194136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.194428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.194703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.202123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5301b8-1c51-4133-aae9-156ca75c8037 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.214360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:04.215951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.239625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.240585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.241137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.241690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.254101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.256178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:04.273012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:04.274001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:04.274894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:04.274894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:04.274894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:04.281948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 394/792] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:04.283140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.286423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.290683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 399/793] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:04.299424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.359258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.399020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b96e-a66d-46b5-ba7d-93bff707ecf6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.442518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.443228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.443453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.443725 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.448178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857dc16-9018-4128-bdb9-6627a19b1645 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.454266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.455750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b4f8ff07-d3f6-4ee1-9e5c-793586157bde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:04.470732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:04.471753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:04.472722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 395/794] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:04.473880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f3a3-cebc-4f30-ad25-e07a83ec8d61 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.474160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f3a3-cebc-4f30-ad25-e07a83ec8d61 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.474435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f3a3-cebc-4f30-ad25-e07a83ec8d61 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.479199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 396/795] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:04.481825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f3a3-cebc-4f30-ad25-e07a83ec8d61 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.493579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.494186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.494465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.494737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.495435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:04.495739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.497704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd6da-8f8d-4ea9-b5c0-04905980bf48 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.510242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 400/796] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:04.516008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.516352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.516639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.535002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:04.536227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.571663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.620229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f3a3-cebc-4f30-ad25-e07a83ec8d61 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.635104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 401/797] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:04.635104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.655801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.656409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.656685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.656953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.657671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:04.657971 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.659507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.661743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.678760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 397/798] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:04.679669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.749274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae097b-0fdd-4851-8b68-4f862d2a9792 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.785251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.785876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.786153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.786423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.794366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.795909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:04.807738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:04.808713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 402/799] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:04.810636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.813178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b970-cbaf-45ee-bd68-30574e52772c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.849463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.853311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.854010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.854295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.854566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.867276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:04.872370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:04.873383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:04.874636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 398/800] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:04.875644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.907738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.924530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7da6-f23f-4f69-a1e2-740a15ceb9c1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.961431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.962068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.962351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.962622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.973557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.975007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.985160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a719-85c4-4140-b0b5-77cddda8296f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:04.990625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:04.991619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:04.997231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:04.997231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:04.997231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:04.997231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 403/801] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:04.997231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.031163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.031772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.032188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.032469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.033335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.033642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.035075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.054710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 399/802] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.059012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.104512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7889-9817-4565-a2dd-2a4b1f27e981 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.104746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.140908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.141520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.141802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.142076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.142746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.143053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.144874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.148172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.157256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 404/803] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.158163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.174594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dbc01-71fa-4363-a521-acb0dfb63615 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.214009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.214633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.214909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.215202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.216449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.217968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:05.226677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:05.227727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 17:26:05.228599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:05.232760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 400/804] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:05.233379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.261651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670ebe-3af7-451c-af3a-9dc7f2140bab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.296569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.297105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.297388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.297664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.298308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.298614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.300022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.311241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 405/805] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.312048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.337981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c80a85-9caa-4db7-9797-946db8cdb615 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.339541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.374883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.375565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.376038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.376319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.376597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.416671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff81eb-8468-44a2-99dd-07a6e20a12d9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.444092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.445480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93d0c-156d-4ef5-bb79-df4c87a980ab None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.449649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.450790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.451076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.451375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.461712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.463155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:05.477480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:05.478437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:05.479366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:05.479366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:05.479366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:05.479366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 406/806] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:05.479366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.547584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 401/807] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:05.548752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbb48-8c43-424f-86ac-1a1bdf3a477a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.549035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbb48-8c43-424f-86ac-1a1bdf3a477a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.549305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbb48-8c43-424f-86ac-1a1bdf3a477a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.550523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 402/808] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:05.551241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bbb48-8c43-424f-86ac-1a1bdf3a477a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.555013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.590268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75ed55-0c27-4742-8175-0b2c0b6ceb6e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.600909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.625484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.626100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.626406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.626689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.627525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.628080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.629757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.634213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 407/809] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.634999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.657864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bbb48-8c43-424f-86ac-1a1bdf3a477a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.691941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.692563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.693207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.693481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.700391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.701815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:05.712552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:05.713587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 403/810] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:05.714838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.741886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6be8-b264-436d-9ec5-74bd5cb3d45e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.775646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.775802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.776261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.776541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.776815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.777446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.777748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.779948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad215a-da28-48ff-98e4-f34be18eb656 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.792274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 408/811] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.793444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.794385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.794881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.812448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:05.813552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:05.815774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4150-6403-482f-8f33-4502c7d1d5a4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.839419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.850277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.850967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.851273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.851543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.863135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.864610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:05.878640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:05.879823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:05.881085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:05.881085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:05.881085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:05.881085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 404/812] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:05.881085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.889665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 409/813] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:05.889665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.989760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968108-1729-4d26-937e-d7ac281548ca None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.990753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763330-f0bf-4904-924b-375ae636cfab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.004140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.025573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.026178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.026457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.026572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.026746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.027166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.027407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:06.027516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.027705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.027807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.029028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:06.029327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.029799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.030805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.039784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 405/814] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:06.039784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.050237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 410/815] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:06.050237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.078114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.149995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309998-302b-48e6-a855-efe69e9373eb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.156469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620b18-ef69-4f8b-901a-d0719ce6ebb9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.184685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.185315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.185602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.185880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.190061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.190665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.190948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.191257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.191901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:06.192207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.193291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.193568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.194714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.205834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 411/816] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:06.206447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:06.207375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:06.208328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:06.208858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.210692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 406/817] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:06.211743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.254009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.293153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.308996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4588e1-6762-4142-9cf7-8bde827dc3c5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.315509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200677fc-ba40-41ff-a630-b5eccf57c035 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.343981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.344519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.344796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.345075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.345724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.347239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.349594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.350242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.350522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.350795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/dd90ca5a48c7411eaee2f3fda54d9dc8/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.352720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=dd90ca5a48c7411eaee2f3fda54d9dc8, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.354196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.467816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 407/818] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:06 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/dd90ca5a48c7411eaee2f3fda54d9dc8/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:06.468661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.484689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 412/819] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:06.486605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.597013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.601836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf284b-f417-4b01-864e-f9a578367e90 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.643558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285c0a-82ed-446e-97c6-b201ea4f47a3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.648089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.648729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.649011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.649283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] PATH_INFO: `/v3/services/network` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.650220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.651681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:06.664754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:06.669067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:06.670374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 408/820] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:06.671236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.693137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.694082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.694765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.695049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.699223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.709108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.711049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:06.725224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:06.726326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:06.727260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 413/821] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:06.727751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.802393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63d85-2fb0-4f7b-a590-2690f65c4168 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.838682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.839334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.839612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.839887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.841326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:06.841736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.843193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.855639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777dfc-31a8-435f-a807-ab6eae089621 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.866826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 409/822] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:06.867796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.892487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.903972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.904866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.905152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.905433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.906406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:06.907037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.908719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.919697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 414/823] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:06.920560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.987622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:07.002827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac760-c2c9-4f15-b583-a586ceb4aba9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.041457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.041936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6265b-9ce7-403f-aaa5-a5358b468e5d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.042259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.042612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.042955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.044285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:07.044673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.046330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.059419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 410/824] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:07.060746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.093477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.094226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.094508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.095039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.110353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.112013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:07.130954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:07.132971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:07.135099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:07.135099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:07.135099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:07.141916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 415/825] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:07.141916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.150383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:07.174826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d117-ef85-48ec-b075-c2222a34940b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.215596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.216257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.216755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.217031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.218101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] RBAC: Adding query filter params (type=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:07.218684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.220367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.227612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 411/826] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:07.228428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.267312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2f26e-1e0a-4dea-b665-56ff988909d3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.281603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:07.303385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.304076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.304437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.304777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.305657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:07.306052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.307837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.319550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 416/827] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:07 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:07.320675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.358526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d792cd-1c39-4b6d-93bf-8fe25ff71ceb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.401536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.402074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.402355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.402629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.403873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:07.404178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.406182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.417685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:07.422858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 412/828] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:07.429530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.537052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc347-59f2-4755-91a9-08a39ada804f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.595719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.595719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.595719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.595719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.596069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.596069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.627582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f650-b828-4fc6-8873-e8de282d4009 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.667142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.668082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.669058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.669554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.679311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 417/829] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:07.680873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.682618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:07.696963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:07.698170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:07.699275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:07.701562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 413/830] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:07.707779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:07.764398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:07.877886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcc746-b3fb-48d6-a6ef-855d7d82ccf0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:07.918362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:07.919665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:07.920297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:07.920571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:07.921274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:07.921582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:07.923011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce79f36-5eeb-47bc-a692-8558ced30a9e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:07.935584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 418/831] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:07.941344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:08.020283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:08.073061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f381a-4dc4-4154-b5fe-a8bf9578e0c7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:08.116766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:08.117432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:08.117710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:08.117982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/89ab0b719a1948b583a8202886902a4a/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:08.139599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=89ab0b719a1948b583a8202886902a4a, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:08.141058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f88b7-ba36-4c51-8df2-c184802dbe3b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:08.209925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 414/832] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:07 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/89ab0b719a1948b583a8202886902a4a/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:08.538327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe35cc-28a7-454e-b383-6c905b41b1b2 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:08.538879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe35cc-28a7-454e-b383-6c905b41b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:08.539238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe35cc-28a7-454e-b383-6c905b41b1b2 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:08.541002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 419/833] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:08.546855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:08.547300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:08.547725 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:08.568137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:08.569345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:08.597030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2825-88c6-44cd-81ad-fd54718b7ce0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:08.597596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2825-88c6-44cd-81ad-fd54718b7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:08.597991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2825-88c6-44cd-81ad-fd54718b7ce0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:08.599915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 420/834] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:08.607289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:08.607575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:08.607851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:08.626855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:08.628092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:08.646463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 415/835] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:08.710936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 421/836] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:08.913051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:08.956726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:08.998172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.017138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917505ec-b84b-4286-a845-7b6fbad7c0e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.018640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.053785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.054421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.054707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.054982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.069062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:09.074486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:09.076293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:09.077328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 416/837] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:09.082498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.116102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9519a-0216-4961-8eeb-ed9ca5ee4765 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.153375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.154102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.154445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.154781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.155467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.157107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:09.166502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:09.169028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:09.171329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:09.173938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 422/838] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:09.174858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.208894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.212767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b837097-8e1b-4ce7-83d7-718d6af7277b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.262682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.264044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.264676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.265075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.265877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:09.266399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.267574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.268991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.282651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 417/839] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:09.288051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.293430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a31691-721e-4107-b646-3cda1b9a187e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.332628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.333264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.333542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.333812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.334435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:09.334847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.336403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.347486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 423/840] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:09.348520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.413014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27af6-ba89-4a17-8b89-b3b3716010a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.462140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.463073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.464128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.464610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.477363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed07ec-7a3b-4b2a-9471-3f783cb6e44a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.482151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.483829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:09.503805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:09.504697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:09.504697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:09.504697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:09.507674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 418/841] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:09.514151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.524669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.525335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.525614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.525891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.526561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:09.526870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.528990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf8c6-fc0c-4d11-b762-9b5e1f0908b5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.535558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.539160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 424/842] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:09.613349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853ae7-d241-47b4-8504-71c5c9188974 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.613880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853ae7-d241-47b4-8504-71c5c9188974 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.614297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853ae7-d241-47b4-8504-71c5c9188974 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.616054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 425/843] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:09.621716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.622086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.622273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.641667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:09.642876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:09.656237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.661707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa4da-ef40-4bda-9f01-5380c86bd4d5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.702097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.702807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.703111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.704014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.705363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:09.705678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.707169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.721357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 419/844] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:09.727322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:09.734661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 426/845] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:09.807219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:09.833412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb300-5b11-4383-a156-0f1d97f91c3a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:09.869133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:09.869770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:09.870101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:09.870382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:09.878308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:09.879794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:09.891855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:09.893663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:09.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 420/846] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:09.903700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.008570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05379d-4bad-4a67-9c92-c3b2f27fc69a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.014568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.052705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.053799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.054350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.054853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.055898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:10.056387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.058328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.069137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.078817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 427/847] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 17:26:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:10.084131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.141964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bda43-e4ad-4432-8856-af53246ed586 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.182051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.182975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.183507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.184011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.185601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.187303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.189883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:10.198537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:10.206436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:10.207800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 421/848] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:10.208606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.208687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3e443-e29d-42d4-ac54-beb511f4968d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.251994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.252985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.253715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.255153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.324032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6323a-2000-4f94-a2ac-1a2ddccb128a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.336011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.340868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.342769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5df04-6622-418b-9810-1f7285e0e671 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.359979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.360593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.360868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.361137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.361762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:10.362062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.363482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3899cf-63f7-4122-881c-adcb310adbe7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.368043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 422/849] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:10.369167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca59d9c-8b68-476c-b0ea-fa9841bc827e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.369443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca59d9c-8b68-476c-b0ea-fa9841bc827e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.369712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca59d9c-8b68-476c-b0ea-fa9841bc827e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.375169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 423/850] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:10.375939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca59d9c-8b68-476c-b0ea-fa9841bc827e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.444524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.459442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 428/851] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:10.460691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.460974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.465070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.479779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:10.480977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:10.498274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca59d9c-8b68-476c-b0ea-fa9841bc827e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.534912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.535550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.535832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.536102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.536727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:10.537032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.538389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.543448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 424/852] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:10.548072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.564366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 429/853] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:10.674211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb308-760e-4ee6-989e-89cad88f2810 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.707616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.718016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.718656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.718936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.724103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.729888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.731397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:10.745498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:10.746977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:10.748066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:10.748066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:10.748066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:10.748066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 425/854] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:10.756194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.785801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.854772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.870214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a320a2-a06d-4cbb-941b-45fbe7216c2a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:10.907701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:10.908307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:10.908586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:10.908857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:10.909494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:10.909795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:10.911194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:10.924214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 430/855] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:10.929831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:10.983803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ec82-c49d-458a-ba19-67d4f659509c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.023651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.024278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.024554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.024824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.036426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:11.041560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:11.042514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:11.048815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 426/856] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:11.050601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.066844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.082800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cddeb-f5da-4951-8013-4b76c654f600 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.096088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.124699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.125685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.126225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.126693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.135424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.137849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:11.150774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:11.151729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:11.152638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:11.156084 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 431/857] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:11.162309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33278f-10cb-4297-8059-9d11be9d8832 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.162469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.198276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.198892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.199216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.199477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.200900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:11.201211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.202654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.217273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 427/858] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:11.218783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.285558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec883-b12d-4be6-bb71-23bfd3f7b06d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.324173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829fca-884b-426e-b446-65959a932d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.325667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829fca-884b-426e-b446-65959a932d46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.326170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829fca-884b-426e-b446-65959a932d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.326281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829fca-884b-426e-b446-65959a932d46 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.326944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db829fca-884b-426e-b446-65959a932d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:11.327294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db829fca-884b-426e-b446-65959a932d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.328735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db829fca-884b-426e-b446-65959a932d46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.342551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 432/859] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:11.348951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829fca-884b-426e-b446-65959a932d46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.351360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.355618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deda4c-7b0e-422b-bce4-e44cfca466f4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.362164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.404357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.405624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.406256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.406779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.421862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.424481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:11.444130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:11.445322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:11.446676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:11.446676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:11.446676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:11.453721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 428/860] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:11.456687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829fca-884b-426e-b446-65959a932d46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.514510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.515161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.515448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.515769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.516688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=dd90ca5a48c7411eaee2f3fda54d9dc8) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:11.516911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.518446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410db57-2242-46c1-8616-4dcf1094fcf3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.531232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 433/861] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/role_assignments?user.id=dd90ca5a48c7411eaee2f3fda54d9dc8&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:11.539555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b660f-2e6f-4399-8f6d-b493a6903004 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.539892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b660f-2e6f-4399-8f6d-b493a6903004 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.540116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b660f-2e6f-4399-8f6d-b493a6903004 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.541832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 434/862] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:11.548008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.548322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.548575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.570495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:11.572054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:11.605151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fe2-8561-4628-af13-c92e9aa0cc1c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.646867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.647978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.648524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.648987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.649892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:11.650360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.652175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.663615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 435/863] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:11.670865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 429/864] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:11.672606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.678176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.789518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b936c-7e56-4b95-b81c-781fc4636f75 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.828301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:11.829014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:11.829295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:11.829569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:11.836981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:11.838566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:11.851506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:11.852486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:11.853586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 436/865] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:11.860907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.879475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:11.931566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:11.966882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8ed2-0dcc-4ae0-ac7d-400947fa0ae0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:11.999673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:12.003211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.004080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.004580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.005073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.005996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:12.006506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.008167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.033303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 430/866] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:12.034941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:12.041999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5cfee-c89b-4913-98c6-f33f4bf280ba None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:12.078662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.079330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.079608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.079877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.080591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.081963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.111556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:12.138573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 437/867] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:11 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:12.144364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bfc05-6053-4a00-8839-35fe4bd423ee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:12.194250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.195267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.196098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.196568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.276262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.278793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.347979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:12.389415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 431/868] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:12 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:26:12.392873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:12.506587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac0712-f401-413e-b371-c07fe0a9331b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:12.530882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:12.542153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.542792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.543068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.543442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.554596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.560450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3451d1df-bbd0-437c-8542-3e0512e3e475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:12.571482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:12.573282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:12.574270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:12.574270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:12.574270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:12.574270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 438/869] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:12.581391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:12.647317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001213c-5d4a-4375-8ad9-d8f2525a2599 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.647754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001213c-5d4a-4375-8ad9-d8f2525a2599 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.647861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001213c-5d4a-4375-8ad9-d8f2525a2599 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.649212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 439/870] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:12.654713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.655273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.655750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.675391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:12.676940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:12.693581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c996df-5876-4ad6-9eb2-826fc8b3f01c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:12.734507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.735180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.735464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.735736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.736483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:12.736790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.738262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.762695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 432/871] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:12.762695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:12.762944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 440/872] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:12.811470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:12.868043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea250c3b-70a1-4220-84f5-977a62c6632c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:12.907434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:12.907434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:12.907434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:12.907434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:12.913045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:12.914679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:12.926565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:12.927519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:12.928414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:12.930709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 433/873] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:12.936348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:13.044254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678509aa-bb38-4a7f-86e3-324ed66c95ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:13.047033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:13.056898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:13.089788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:13.091754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.092242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.092944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.094239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:13.094991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:13.096996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:13.114228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 441/874] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:13.120198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:13.164265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:13.184767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f7c9-fda5-4665-a8dc-64f04c17b8b5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:13.230543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:13.231697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.231827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.232092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.232757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:13.232965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877dfa-9408-4fcb-90f4-2b30169f5df5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:13.234128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f36a9-bb59-409f-9c6e-b7fc7f800353 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:13.272886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:13.273495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.273774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.274049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.274771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=89ab0b719a1948b583a8202886902a4a) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:13.275156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:13.276617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370db8-be03-4739-ac20-4e3af41b095d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:13.282870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 442/875] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:13 2022] GET /identity/v3/role_assignments?user.id=89ab0b719a1948b583a8202886902a4a&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:13.336990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 434/876] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:13 2022] POST /identity/v3/services => generated 269 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:13.579604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a461-cd37-4f78-b53a-c27279d5d701 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.580110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a461-cd37-4f78-b53a-c27279d5d701 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.580185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a461-cd37-4f78-b53a-c27279d5d701 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.581860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 443/877] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:13.587666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.587775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.588043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.611181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:13.612736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:13.690710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 435/878] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:13.962118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42a461-cd37-4f78-b53a-c27279d5d701 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:13.992409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:14.076229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42a461-cd37-4f78-b53a-c27279d5d701 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.112636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.113321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.113610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.113887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.114470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.115869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-af3be795-a37d-4116-8874-1ca32ffeadab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:14.125728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:14.126714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:14.127588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 444/879] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:14.133058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.143539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4bd2c-87da-49c0-be62-b2b5c628a7cb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.143818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4bd2c-87da-49c0-be62-b2b5c628a7cb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.144091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4bd2c-87da-49c0-be62-b2b5c628a7cb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.145686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 445/880] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:14.152342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.152714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.153054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.176039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:14.177239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:14.226000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:14.259185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 446/881] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:14.264741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8233-b2f5-48ea-9e2b-e79254b037b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.301256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.301873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.302154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.302429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.303059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:14.303390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.304762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.311331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 436/882] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:14.317208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.342924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:14.424104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232f45-c7e0-47da-b6cd-5a808a0b3f8a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.460893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.461937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.462451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.462962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.463919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:14.464440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.466613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.479318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 447/883] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:14.553559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.665314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ebc7-048c-48b9-93b6-16cf1f31d0fb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.702079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.702715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.703002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.703305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.703885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.705260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.708429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:14.716059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:14.717067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:14.718334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 437/884] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:14.723646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.818878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:14.835838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b501f-2a5f-4a80-a444-7ff799febc5e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.875032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.875673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.875955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.876228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.876900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:14.877228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.878713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.884531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 448/885] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:14.892499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.013033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0276ab-9c4c-440c-b525-f5d1c9c4473d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:15.049619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:15.050227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.050561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.050836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.051489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:15.051790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:15.053156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:15.058633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 438/886] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:15.068169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.177397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f02b-93d2-410e-a05b-4fce209a1662 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:15.214762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:15.216279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.216598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.216897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.217574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] RBAC: Adding query filter params (interface=public, service_id=b6c8b4b4954b45a08479690f86e0faab, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:15.217876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:15.219269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dba892-f0d5-4104-a375-278784734249 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:15.225003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 449/887] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/endpoints?service_id=b6c8b4b4954b45a08479690f86e0faab&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:15.230683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.299415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:15.304141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f48c-191b-4d9e-814a-dc4fa5f81346 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.304659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f48c-191b-4d9e-814a-dc4fa5f81346 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.305167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f48c-191b-4d9e-814a-dc4fa5f81346 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.307012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 450/888] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:15.314325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.314886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.315376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.337073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:15.339200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:15.344914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb08b-18b5-4ec6-8f03-9f639d59578e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:15.351572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:15.391268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:15.391985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.392183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.392481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.393220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:15.394603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a3c4f-77a0-4d42-b98a-6dcf06a32a0b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:15.400725 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 439/889] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:15.401866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fc06-ea3f-4fe2-b375-c16c53435188 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.402159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fc06-ea3f-4fe2-b375-c16c53435188 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.402438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fc06-ea3f-4fe2-b375-c16c53435188 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.404084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 440/890] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:15.410455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.411338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.415485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.431246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:15.432240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 451/891] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:15.435998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:15.520097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 441/892] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:15.720572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.800196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.832102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b971fe-77d5-4198-81a5-b5a62ac7d371 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:15.868441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:15.869080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.869346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.869721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.870189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:15.872132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:15.872245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:15.884429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:15.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:15.892507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 452/893] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:15.893302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.903571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:15.925795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323765-a88a-493d-9c04-33aae59d4c97 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:15.963635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:15.964550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:15.965021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:15.966134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:15.977840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:15.983944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:15.984898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:15.985754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:15.988527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 442/894] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:15.998108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:15.999347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abfdb3-b679-4dea-aa2a-c30e4a4d8e12 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.035300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.036023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.036306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.036580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.037212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.037514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.038882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.048539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 453/895] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:16.049451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.117576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b472f-db4f-423e-9519-59b1d9153bd1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.137791 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.147456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.158095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.159022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.159578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.160057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.160925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.161478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.163160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.178620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 443/896] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:16.179959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.185097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae966-f982-4856-aaaa-ed79e6b98190 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.228790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.229321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.229600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.229871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.231640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.231976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.233501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.243243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 454/897] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:16.247615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.311685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bf6c0-d780-4993-968d-3937ecff933c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.351618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.352781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.353270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.353747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.366599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.368582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.370869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130f5d-bf85-4463-9f5f-ca1b303e4048 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:16.385387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:16.386406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:16.387966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:16.387966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:16.387966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:16.395004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 444/898] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:16.396435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.412679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.413299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.413580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.413854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.414840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] RBAC: Adding query filter params (interface=public, service_id=40f14de63da647b081a768c1b18285e7, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.415171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.416543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.420850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.430317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 455/899] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/endpoints?service_id=40f14de63da647b081a768c1b18285e7&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:16.431853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.441157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.535599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d5fbd-57fa-4ece-b4bb-625a6cac9e4a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.566765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73731e-f7e8-44e3-8e38-26480dd80bb6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.583274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.584301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.584827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.585312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.588754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.589193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.591253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cb595-f1d4-4647-b6da-46770db58c2e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.603807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 445/900] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:16.605145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85cec3-0343-458e-b07a-56dc73cbbccb None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.605437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85cec3-0343-458e-b07a-56dc73cbbccb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.606351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85cec3-0343-458e-b07a-56dc73cbbccb None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.611143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 446/901] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:16.611143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85cec3-0343-458e-b07a-56dc73cbbccb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.619047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.619994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.620291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.620567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.621269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.623254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8646-0aab-4f40-8f26-daa52c1335d5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.637528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 456/902] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/services => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:16.637528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.637528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.637528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.652036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:16.653394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:16.730943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.741154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 457/903] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:16.752707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.759794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85cec3-0343-458e-b07a-56dc73cbbccb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.799387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.799958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.800251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.800776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.809228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.810757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:16.822833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:16.823839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:16.825396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 447/904] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:16.832051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.939549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3c98-854e-4a46-bc2e-673326b13fa0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.976481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.977351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.977785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.978215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.979118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:16.979583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.981768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.000375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 458/905] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:17.006397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.016256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.085820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:17.132389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fc247-235e-4bfa-beee-40f4a38f9a4b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.133520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044bfa3-2499-4cbf-89f6-96c0eb4504e2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.172068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.172676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.172958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.173232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.173876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.175272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.177772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.178836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.179342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.180125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.204491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:17.249213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 459/906] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:17.253000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.254526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68195d5-3a52-429e-8fad-d34f8aa08edf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.377909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 448/907] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:17.384410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.477474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286108c5-f029-495d-9e50-8aa4f3584b8a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.477818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286108c5-f029-495d-9e50-8aa4f3584b8a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.478037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286108c5-f029-495d-9e50-8aa4f3584b8a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.479643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 449/908] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:17.485350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.485646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.485907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.504825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:17.506021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:17.511367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53767f3-21b3-4d78-bd34-2873eb7d7953 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.521910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:17.551284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.552144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.552550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.553224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.561632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:17.566946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.568667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.582588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 450/909] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:17.585567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:17.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:17.587658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:17.587658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:17.587658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:17.589834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 460/910] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:17.598975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.707483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247451-624f-40d8-b07d-5a64d89a6d39 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.743903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.744514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.744794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.745068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.745713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:17.746018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.747521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.759701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 451/911] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:17.765312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.880138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323b5b-b11d-4ecb-9e73-a29d770c24a8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.884301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.916223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.916949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.917236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.917512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.924660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.926116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.933500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:17.939536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:17.941166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:17.942242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 461/912] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:17.950799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.975306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.015477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27b40-9203-4aeb-ae74-b48852222e52 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.066399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed634d9a-bf15-47a8-8b18-54d965c8afdb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.070139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.071528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.072225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.072811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.073551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.076303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:18.088517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:18.089766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 17:26:18.091638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:18.094871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 452/913] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:18.104729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.113285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.114030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.114413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.114787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.115621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:18.116031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.117656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.131887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 462/914] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:18.139756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.233738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36f33-3659-4d4d-bf09-c68ec30f9407 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.242535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.243424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.264947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b73a-1866-46fd-8aac-381d53a751e0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.275566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.276178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.276456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.276842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.278188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:18.278694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.280229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.290656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 453/915] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:18.292121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.317627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.318252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.318597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.318884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.319715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] RBAC: Adding query filter params (role.id=a25d390c237843519f5a791c4161536d, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=89ab0b719a1948b583a8202886902a4a) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:18.320037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.322406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.331397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 463/916] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/role_assignments?user.id=89ab0b719a1948b583a8202886902a4a&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=a25d390c237843519f5a791c4161536d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:18.432399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c7ca-c6ea-4c40-a758-221335ed2027 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.477261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.477912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.478198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.478475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.479276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:18.479614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.481621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa848987-91a2-4a11-99fa-be1eac7419c5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.489444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 454/917] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:18.499021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.632975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef81a-b17e-4f07-8e6d-5488ebfb8958 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.675638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.676328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.676603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.676884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.677564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.678930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.755802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.758027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9136-944b-4c82-9b05-8bc767bf6265 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.758318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9136-944b-4c82-9b05-8bc767bf6265 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.758595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9136-944b-4c82-9b05-8bc767bf6265 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.760301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 455/918] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:18.769628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708b46-28a8-4793-9d99-9776d871763b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.774641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708b46-28a8-4793-9d99-9776d871763b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.774641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708b46-28a8-4793-9d99-9776d871763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.774839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 464/919] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:18.795464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f9708b46-28a8-4793-9d99-9776d871763b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:18.797179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9708b46-28a8-4793-9d99-9776d871763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:18.831499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.886786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 456/920] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:19.210011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.319834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2853387-9c48-4327-bb70-143779615a2a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.351132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff4f0-f157-46bc-ac0e-9646ca0c61d1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.352675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff4f0-f157-46bc-ac0e-9646ca0c61d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.352675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff4f0-f157-46bc-ac0e-9646ca0c61d1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.354314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 457/921] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:19.357882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.358572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.358855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.359156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.359746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.360311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.360815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.361106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.361528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:19.370945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:19.372072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:19.373702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 465/922] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:19.378206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.388421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:19.389981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:19.455722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.490811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 458/923] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:19.503150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ce4-309c-4158-a17a-db16f108ad7c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.540073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.540696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.540981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.541245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.541878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:19.542184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.543848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.549087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 466/924] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:19.554417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.658719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.663982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015062-396d-4ae1-86f8-09c8e7e96654 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.697927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.698532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.698807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.699076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.700271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:19.700572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.701933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.707076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 459/925] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:19.713359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.778784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.831133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1b2b-4246-4da2-bb68-00c5b5b98a45 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.869264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.881212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.881970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.882388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.883159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.889840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.889840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.912129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e66e4-8483-40fe-97c2-631c3912bd6a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.948572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.949328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.950818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.950818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.951008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.952390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:19.961479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:19.962568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:19.963449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:19.967854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 460/926] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:19.969238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.990413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.027438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 467/927] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:20.094368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ff7d5-6445-4ec8-acb0-6f286fe7c661 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.140462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.141208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.141557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.141898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.142607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:20.142982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.144525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.155095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 461/928] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:20.156507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.267444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0296c-c1c3-4325-a132-3ff6d135ad1b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.303452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.304163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.304510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.304856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.305626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:20.306002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.307486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae343-a14b-4771-95cc-e6b1c4f5e161 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.318288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 468/929] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:20.319662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.404735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.428125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2d20-d004-4aac-bf3a-02120dbd9094 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.464229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034487-0680-40a3-97bd-bf49f862b7ac None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.464562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034487-0680-40a3-97bd-bf49f862b7ac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.465330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034487-0680-40a3-97bd-bf49f862b7ac None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.467172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 469/930] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:20.472123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518427be-89a6-4656-89e7-d834f6ab9d25 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.472478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518427be-89a6-4656-89e7-d834f6ab9d25 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.472859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518427be-89a6-4656-89e7-d834f6ab9d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.476102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.476885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.477186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.477463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.478255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] RBAC: Adding query filter params (interface=public, service_id=e7c8775e9d974fd5bb49b039c34dd17e, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:20.478579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.480307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.487820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 462/931] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/endpoints?service_id=e7c8775e9d974fd5bb49b039c34dd17e&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:20.497073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.502033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-518427be-89a6-4656-89e7-d834f6ab9d25 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:20.502567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-518427be-89a6-4656-89e7-d834f6ab9d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:20.553777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.586052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 470/932] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:20.626843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997638-2049-4a3c-a94f-1f131a6d8f23 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.662211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.663117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.663590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.664044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.664789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.666313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e79f4-5abe-45f6-8c76-b7c8e4716893 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.677954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 463/933] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:20.833137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36ed8-93b0-415d-a409-0edf346b9714 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.833520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36ed8-93b0-415d-a409-0edf346b9714 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.833812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36ed8-93b0-415d-a409-0edf346b9714 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.835324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 471/934] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:20.841219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.841771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.842260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.856406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.862412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:20.873935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:20.880739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36ed8-93b0-415d-a409-0edf346b9714 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.943966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 464/935] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:21.000411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36ed8-93b0-415d-a409-0edf346b9714 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.036659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.037291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.037569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.037840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.048367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:21.052974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:21.054040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.054901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 472/936] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:21.060438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.174794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1486-85ee-47b5-812c-47d97677c874 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.213553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.214099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.214378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.214652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.215901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:21.216202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.217569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.219980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.225726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.227755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 465/937] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:21.233844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.272642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.354043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b683b-3166-47a3-9734-60f08a939602 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.360098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e439ac-4f15-4964-8858-9880b82f0e08 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.392060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.392686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.392963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.393228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.407686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.409918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.413010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.413629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.413913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.414242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.414888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.416345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.420550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING keystone.server.flask.common [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:21.425002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:21.425959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:21.426847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:21.426847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:21.426847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:21.426847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 466/938] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:21.436061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.467766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 17:26:21.467766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 17:26:21.467766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [parameters: {'id': 'f87b0e053a1f4ee396e195c614b623fd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 17:26:21.467766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87b0e053a1f4ee396e195c614b623fd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87b0e053a1f4ee396e195c614b623fd. Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:26:21.476093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 17:26:21.477632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Aug 24 17:26:21.479461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 17:26:21.481401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 17:26:21.483003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:26:21.495704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'id': 'f87b0e053a1f4ee396e195c614b623fd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.500870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:21.502476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87b0e053a1f4ee396e195c614b623fd. Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 473/939] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 17:26:21 2022] POST /identity/v3/projects => generated 262 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:21.504298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.505509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.546609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10db-9f53-4f66-acf7-daac66ac1f8d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.584213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.584826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.585105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.585379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.586092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:21.586499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.587781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.605156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 467/940] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:21.606896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.607217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.615067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a33b-33f5-493d-bfe3-57fa939154e0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.653284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.654186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.654644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.655054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.662375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.664351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:21.677801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:21.678919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:21.680095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:21.687231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 474/941] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:21.689049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.717105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbedb53-11d9-46e5-b562-70cf729d9f7c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.729931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.754663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.755340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.755621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.755963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.765184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.767113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:21.779615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:21.780809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:21.781994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:21.785521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 468/942] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:21.786390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.804055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa25d-f4be-42ec-9e5f-ba2cb1d9081e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.842642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.843527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.843971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.844399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.845272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:21.845717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.847383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.875214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 475/943] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:21.901591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe90a0-8a36-4709-8939-38fe7516898d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.943468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.944093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.944374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.944648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.945631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:21.945945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.947427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f51c9-4d06-4007-bcd6-732649990cd3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.970093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 469/944] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:21.975749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.993824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.089436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3fcd2-9e85-444c-b56f-33e463b97db2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.126028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.127032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.127541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.128006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.139799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.141564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.151389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefaef-e4d9-4bd7-9a56-daf5715b49de None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.151687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefaef-e4d9-4bd7-9a56-daf5715b49de None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.151942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefaef-e4d9-4bd7-9a56-daf5715b49de None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.153958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 470/945] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:22.158481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:22.159606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:22.160560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:22.160560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:22.160560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:22.160731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.160731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.160731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.162885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 476/946] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:22.171984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.178263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:22.179507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:22.205582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.253633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 471/947] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:22.257113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.295383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622352-2de1-4701-9fe3-528721f30ab8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.331486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.332386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.332825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.334040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:22.334498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.336050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.349998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 477/948] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:22.356460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.467905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1c2dd-b1a3-425c-aec9-291007096d1c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.503565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.504601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.505066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.505518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.514119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.515984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:22.528460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:22.529400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:22.530316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:22.532456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 472/949] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:22.538446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.544118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.565203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.659969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d811f-1244-43a4-a2e0-7d2a261f2db0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.678389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53279c-5265-4acb-8dd3-68c56b3065d0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.698904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.699584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.699839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.700133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.700694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.702177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:22.711942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:22.713036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:22.713922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 473/950] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:22.721039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.722736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.731396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.732253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.732681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.733111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.733964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:22.734908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.736877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.752627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 478/951] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:22.758682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.824909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.846931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8baab6-840c-4d8b-9233-89899d419f65 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.873475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feee3d-2fd6-4425-9db8-3ea878700084 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.898634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.899277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.899564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.899840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.900479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:22.900781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.902142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559e21a-0b90-4fc0-8713-c18677a658b1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.908088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 474/952] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:22.909260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdb70-6f9e-4f10-b3a0-20833448a140 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.909547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdb70-6f9e-4f10-b3a0-20833448a140 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.909820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdb70-6f9e-4f10-b3a0-20833448a140 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.911236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 475/953] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:22.915890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fdb70-6f9e-4f10-b3a0-20833448a140 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.916253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.917102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.917388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.917663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/89ab0b719a1948b583a8202886902a4a/roles/a25d390c237843519f5a791c4161536d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.920586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=89ab0b719a1948b583a8202886902a4a, role_id=a25d390c237843519f5a791c4161536d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.922029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744dbc-a527-4e39-b9c4-a344fa7322b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.970903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 479/954] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:22 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/89ab0b719a1948b583a8202886902a4a/roles/a25d390c237843519f5a791c4161536d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:22.972635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.973132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.973491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.004378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:23.006444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:23.045384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fdb70-6f9e-4f10-b3a0-20833448a140 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.067583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.111113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 480/955] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:23.113876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.114520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.114914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.115228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.115963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:23.116254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.117747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.123649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 476/956] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:23.386090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.494153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b236c-281b-44be-b2a5-887c51d1e976 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.530326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.530962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.531275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.531551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.532192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.533633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:23.542714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:23.544353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:23.545196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 481/957] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:23.550712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.564476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.666190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa616-abe3-4786-86e8-3d1776ae3cec None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.708621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.709234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.709514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.709788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.710413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:23.710717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.712107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.717272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 477/958] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:23.722664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.771631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.832095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232538-a8da-4e28-b48d-99143c2cfb74 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.867573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.869821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26bf4f-e311-4d95-94b9-39541c39c093 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.877829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 482/959] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:23.884692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.962301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.987922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9cb7c-bd32-4c0f-abdd-308591d92ee6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.023733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.024342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.024622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.024894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.025596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.027001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.081693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8bbc-f57c-4ad1-ab4b-7d7dbb844a14 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.082110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8bbc-f57c-4ad1-ab4b-7d7dbb844a14 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.082282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8bbc-f57c-4ad1-ab4b-7d7dbb844a14 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.084035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 483/960] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:24.091988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.092295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.092540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.108124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 478/961] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:24.119029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:24.121680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:24.218351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 484/962] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:24.501847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.615350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec03409-5812-400a-ac3c-2797d8d01b27 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.647252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:24.653936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.654605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.655042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.655349 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.656013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.663054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.663054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING keystone.server.flask.common [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 17:26:24.705740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 17:26:24.705740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 17:26:24.705740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [parameters: {'user_id': 'a46b67da9f064445bcc9310c4ffd7cd5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 17:26:24.705740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Aug 24 17:26:24.723782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:26:24.724748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 17:26:24.725742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 17:26:24.726654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 17:26:24.729100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 17:26:24.731967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a46b67da9f064445bcc9310c4ffd7cd5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:24.735863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 17:26:24.737768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:24.744317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 479/963] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 17:26:24 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:24.744724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.772245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:24.849989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481cc67-0da2-48ae-89d0-fbae7fd7efca None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.887248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.888276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.888779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.889269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.896979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.898706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-85e80f10-978a-49ee-99db-a4e03ddb9c06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:24.910879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:24.911904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 17:26:24.912857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:24.915529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 485/964] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:24.923535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:25.034620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09262cb-3578-418b-a0e5-1eced8909e8b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:25.075144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:25.075779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.076064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.076341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.077049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:25.077397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:25.079043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca9bb-3626-4db6-be35-81b2784ddf59 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:25.084786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97d11-f240-4db0-8a2c-fd4fa63b9aac None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.085070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97d11-f240-4db0-8a2c-fd4fa63b9aac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.085345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97d11-f240-4db0-8a2c-fd4fa63b9aac None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.086949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 486/965] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:25.092078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b37e-e9b7-4e27-98c7-8fe6f849ed8e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.092359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b37e-e9b7-4e27-98c7-8fe6f849ed8e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.092633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b37e-e9b7-4e27-98c7-8fe6f849ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.110835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-76d4b37e-e9b7-4e27-98c7-8fe6f849ed8e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:25.112070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-76d4b37e-e9b7-4e27-98c7-8fe6f849ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:25.127234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 480/966] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 17:26:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:25.196468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 487/967] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:25.204133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a872ad-c600-41f4-895b-0c619a89ea96 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.204423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a872ad-c600-41f4-895b-0c619a89ea96 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.204708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a872ad-c600-41f4-895b-0c619a89ea96 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.206464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 481/968] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:25.211935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.212265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.212489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.233028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:25.234256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:25.251257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:25.311224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 488/969] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:25.482443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a872ad-c600-41f4-895b-0c619a89ea96 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:25.535400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:25.578522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:25.594758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a872ad-c600-41f4-895b-0c619a89ea96 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:25.631294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:25.632154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.632410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.632688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.646179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:25.650835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:25.651819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:25.653254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 482/970] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:25.658263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:25.690849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c29b6-c3c0-44b0-b4d3-8ee4de254a3a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:25.729124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:25.729726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.729918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.730202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.731052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:25.732279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:25.765612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2586-afe9-4b77-9254-a6d9eb4153e6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:25.776568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:25.791344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 489/971] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:25 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:25.813502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:25.814237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.814525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.814808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:25.815550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:25.815859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:25.817294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:25.832692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 483/972] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:25.834368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:25.851020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:25.952539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d290ee-8992-45e5-86c0-dd54d601899c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:25.993088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:25.993730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:25.994014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:25.994289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.005782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.007304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b504a459-8873-4945-86bf-afcf6fc59ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:26.022201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:26.023207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:26.024144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:26.024144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:26.024144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:26.027623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 490/973] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:26.030638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.133388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81e30-6c1e-454b-9a1d-fe44b6837afe None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.133646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81e30-6c1e-454b-9a1d-fe44b6837afe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.133899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81e30-6c1e-454b-9a1d-fe44b6837afe None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.135376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 491/974] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:26.136109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf2c9-8c7e-44b5-85b9-a299dc8bd9e7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.140825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.141116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.141397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.160836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:26.162044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:26.173306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.173930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.174215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.174496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.175166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:26.175477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.176838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.189080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 484/975] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:26.194496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.227465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.228920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.240048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 492/976] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:26.312015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1186f74-e5d9-4cf0-846f-237d5afad6a4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.349331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.350217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.350645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.351114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.359210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.360933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:26.374939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:26.376039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 17:26:26.376984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:26.377530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 485/977] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:26.382893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.499416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbaa9b-7ca7-4d5d-b2bb-7060bb6fdace None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.522422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.534371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.534984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.535295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.535568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.536312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:26.536597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.538032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.557004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 493/978] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:26.562889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.619139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.634101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.649976 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0961484-9922-413e-9b1f-87a3f38099d5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.670403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d5c3-3528-441f-85f8-25516493b56b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.693505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.694142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.694408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.694675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.695534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.696898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:26.706769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:26.707827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:26.708701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 486/979] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:26.710734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.711403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.711664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.711941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.713696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.783112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.784581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.823642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6b810-b706-4ef8-8d3c-86f3df0328fd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:26.835333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.862998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:26.863639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:26.863955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:26.864235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:26.865137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:26.865448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:26.866814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:26.872154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 487/980] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:26.877644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.896684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 494/981] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:26:26.897921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:26.903860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:26.992937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bca-488d-4e5e-970c-85584ca8093e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.009270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087240-38dd-4a4a-af1d-0de2bf1a7848 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.029883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.030494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.030776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.031103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.031734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:27.032039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.033449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.038259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 488/982] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:27.044086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.049307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.050193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.050670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.051182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.062643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.064563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:27.084391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:27.085396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:27.086288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:27.086288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:27.086288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:27.086288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 495/983] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:27.091908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.094709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.147923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.170571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48df0c-b7bf-4aad-b3e0-44f7a7ff22b1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.206490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4d59-26ce-4d3f-b37a-ca1c83f84146 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.207846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.208461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.208746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.209024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.209732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] RBAC: Adding query filter params (interface=admin, service_id=e7c8775e9d974fd5bb49b039c34dd17e, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:27.210040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.211453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.217493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 489/984] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/endpoints?service_id=e7c8775e9d974fd5bb49b039c34dd17e&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:27.223238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.244910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.245521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.246330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.246604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.247520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:27.247937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.249318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.263482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 496/985] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:27.269705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.333677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b63-f400-42f5-be0c-709e2d51af71 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.340383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.371643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.372703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.372986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.373263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.373876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.375281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.391119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 490/986] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:27.394244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4759a-1816-42fb-ab37-11d664b52d8b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.436745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.437410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.437695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.437968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.446143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.447789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:27.462424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:27.463696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:27.464857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 497/987] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:27.471692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.484591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.587111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f7a46-5308-46e9-9e44-fbfb8c682230 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.623821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.624445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.624731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.625005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.625700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:27.626006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.627473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af791f29-4008-4dba-9ae3-931d3fca5f75 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.641197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 491/988] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:27.649643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.740949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536158-6615-47ee-8ff2-855989dcc02f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.741273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536158-6615-47ee-8ff2-855989dcc02f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.741504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536158-6615-47ee-8ff2-855989dcc02f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.742862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 492/989] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:27.748799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.749085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.749358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.758822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0227c-f602-4202-bef4-860587d2df2b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.769738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:27.771635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:27.787217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.800631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.801339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.809261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.809261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.809261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] RBAC: Adding query filter params (role.id=a25d390c237843519f5a791c4161536d, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=89ab0b719a1948b583a8202886902a4a) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:27.809261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.809261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:27.811923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 498/990] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:27 2022] GET /identity/v3/role_assignments?user.id=89ab0b719a1948b583a8202886902a4a&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=a25d390c237843519f5a791c4161536d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:27.846862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:27.853832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 493/991] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:28.120249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.227030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6f09-efcb-46cd-8697-f8072d10b008 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.261545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.262640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.262928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.263229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.263815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.265198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:28.274346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:28.275772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:28.276630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:28.279166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 499/992] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:28.282258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.389944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244ef87-070c-43bb-aa7d-c0e36fa72cad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.427388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.428005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.428283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.428553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.429188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:28.429486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.430881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.442093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 494/993] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:28.443366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.498555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:28.551832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4ee3-f63f-41f7-a627-5d42503d4026 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.591599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.592251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.592537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.592812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.593446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] RBAC: Adding query filter params (type=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:28.593747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.595129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.605062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 500/994] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:28.606829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.670066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:28.710205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704446bd-38c2-4f1e-a663-20b491efb943 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.745052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.745665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.746652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.746981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.747722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] RBAC: Adding query filter params (interface=public, service_id=527efb48dfa1477381709ebd3175ba78, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:28.748085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.749451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e50eb-137d-45fb-a663-fdf3b525fdc6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.758963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 495/995] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/endpoints?service_id=527efb48dfa1477381709ebd3175ba78&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:28.760309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.886096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5fb83-7b9c-49f9-aef2-59ded97218af None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.901345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:28.922029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.922615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.922896 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.923189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.923794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.925152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e251-b043-47a0-8e0e-58436a273992 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.931656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 501/996] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:29.374078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084883c-7fc0-4fd1-8755-0b13249a472c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.374530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084883c-7fc0-4fd1-8755-0b13249a472c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.374629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084883c-7fc0-4fd1-8755-0b13249a472c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.376057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 496/997] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:29.381610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e35bd-6513-4114-8a08-b4e0c540ac32 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.382084 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e35bd-6513-4114-8a08-b4e0c540ac32 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.382198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e35bd-6513-4114-8a08-b4e0c540ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.400670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-551e35bd-6513-4114-8a08-b4e0c540ac32 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:29.401882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-551e35bd-6513-4114-8a08-b4e0c540ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:29.474492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 502/998] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:29.746900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084883c-7fc0-4fd1-8755-0b13249a472c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:29.840738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335256df-f267-45c8-aa5c-9e736f210ee1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.841034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335256df-f267-45c8-aa5c-9e736f210ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.841316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335256df-f267-45c8-aa5c-9e736f210ee1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.842668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 503/999] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:29.847847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.848141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.848421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.852377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084883c-7fc0-4fd1-8755-0b13249a472c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:29.866669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:29.867887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:29.881812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:29.892627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:29.893267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.893551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.893826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.896200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:29.896200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:29.906342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:29.907687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 17:26:29.908547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:29.911213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 497/1000] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 17:26:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:29.916853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:29.944086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 504/1001] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:30.027763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971011-1671-4411-bccd-f3a95efcd675 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.062102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.062729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.063010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.063311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.063955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:30.064284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.065684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.076642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 498/1002] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:30.077817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.119679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.180306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db802b71-4b42-4c0e-a5dd-fbf6ba6a9b8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.216459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.216901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.217190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.217435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.217548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.218091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:30.218404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.219816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.230719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 505/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 17:26:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:30.231869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.278354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.326499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81137ea-3cf3-42df-85aa-c65dc6050abb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.355834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9d83f-610c-4a21-b68d-c16ce9e9720e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.357519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.365894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.366541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.366823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.367363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] PATH_INFO: `/v3/services/image` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.367705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.369082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:30.384148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:30.392116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:30.392975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 499/1004] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 17:26:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:30.393793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.400003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.401020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.401526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.402506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.410467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.410467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.506881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 506/1005] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:30.556402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7e80-7507-4397-84b6-28b0229a618f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.581177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.609664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.610285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.610569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.610845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.611516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:30.611822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.613481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4888-3f54-4505-8b41-4de0a48c437f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.619704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 500/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:30.625052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.734066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b73b5-4dca-43af-89ee-35edd442edfb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.768258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.768874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.769156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.769431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.770071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] RBAC: Adding query filter params (type=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:30.770377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.771783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29471cc-0a49-4244-b207-a6d540f99e52 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.776535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 507/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:30.860421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef010-24f6-4a56-bf03-78123dfc9bd8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.860920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef010-24f6-4a56-bf03-78123dfc9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.860920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef010-24f6-4a56-bf03-78123dfc9bd8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.862417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 501/1008] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:30.868029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.868316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.868598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.889000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:30.890243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:30.913554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.963859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 508/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:31.236854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef010-24f6-4a56-bf03-78123dfc9bd8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.347530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef010-24f6-4a56-bf03-78123dfc9bd8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.383454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.384087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.384370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.384764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.385240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.387020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:31.398570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:31.405200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:31.406078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 502/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:31.408527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.516898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a3bd-ce54-46f2-9ff8-88675d7617ee None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.553294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.553914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.554194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.554465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.555169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:31.555432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.556811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.563506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 509/1011] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:31.570934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.622005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:31.682096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f19e9-76a2-426c-b330-ecd43967c7bb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.717876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.718489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.718766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.719041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.719695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:31.720005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.721412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e5825-3a1f-4f13-8035-65f0008a042f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.730927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 503/1012] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:31.732221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.758181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:31.840446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c5c3-7b8f-4dc0-8cb5-fc45d8272fe3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.876441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.877068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.877350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.877671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.878308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.879731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69753f-2302-4b36-8892-102726fbad47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.965530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 510/1013] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:32.478595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb5d-16af-429c-ad72-72a0003de4fb None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.479329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb5d-16af-429c-ad72-72a0003de4fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.479329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb5d-16af-429c-ad72-72a0003de4fb None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.481242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 504/1014] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:32.486631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023671-bc50-4162-97d3-a1f02bc0b50d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.487060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023671-bc50-4162-97d3-a1f02bc0b50d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.487264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023671-bc50-4162-97d3-a1f02bc0b50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.506336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34023671-bc50-4162-97d3-a1f02bc0b50d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:32.509114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34023671-bc50-4162-97d3-a1f02bc0b50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:32.593068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 511/1015] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:32 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:32.708323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54910c-dd0c-4b4d-a0c7-7169b059d5e5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.708640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54910c-dd0c-4b4d-a0c7-7169b059d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.708883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54910c-dd0c-4b4d-a0c7-7169b059d5e5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.710373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 505/1016] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:32.715474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.715768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.716049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.722532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:32.746204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:32.746204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:32.805071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 512/1017] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:32 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:32.863669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54910c-dd0c-4b4d-a0c7-7169b059d5e5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:32.970998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54910c-dd0c-4b4d-a0c7-7169b059d5e5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:32.978414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.006673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.007270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.007552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.007829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.008968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.010405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.012834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 506/1018] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:33.018366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.077477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.125984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6cb40-9238-4dcc-a954-877620fe1086 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.162000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.169730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.169730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.169730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.169730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.175888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.175888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a453a-539c-42f1-b0aa-a887d79360c8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.189398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e096c-89e2-4617-87a7-d81725d273ca None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.229054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.229669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.230004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.230287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.231039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.232561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70049-0668-4b48-927f-fee9baf26d17 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.284369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 513/1019] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:33.309780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 507/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:34.002780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9828-652a-4d22-93d5-c7207897d645 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.003336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9828-652a-4d22-93d5-c7207897d645 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.003336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9828-652a-4d22-93d5-c7207897d645 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.004772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 514/1021] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:34.009703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.010083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.010265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.029147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:34.030324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:34.057722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.105833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 508/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:34.379273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9828-652a-4d22-93d5-c7207897d645 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.487812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9828-652a-4d22-93d5-c7207897d645 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:34.521694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:34.522316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.522591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.522860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.533076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:34.537637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:34.538580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:34.539974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:34.543572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 515/1023] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:34.545438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.654168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488407-7c0a-49fe-90b4-70360af5a45b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:34.689685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:34.690296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.690571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.690841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.691537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:34.691841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:34.693203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:34.703047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 509/1024] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:34.708490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.756902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.813377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070abe65-4937-4a41-bc27-197a91470ac0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:34.850755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:34.851412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.851692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.851963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.863936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:34.865206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:34.880758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:34.881845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:34.882762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:34.882762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:34.882762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:34.883785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 516/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:34.888017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.916452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.996746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ad8d-86e0-42c5-a310-4a2296b40135 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.031682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.032330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.032580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.032823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.033462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:35.033766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.035155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.052047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 510/1026] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:35.053457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.153795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.160206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893814-edf4-4334-99ae-0aa1b5c20a65 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.196206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.196763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.197043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.197374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.205835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.207437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4be56e20-a5f0-4315-88de-5c08bb5d00fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:35.220663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:35.221661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:35.222631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:35.224009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 517/1027] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:35.227707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.263539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f57f-7141-4470-b2fb-a39096a05678 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.263868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f57f-7141-4470-b2fb-a39096a05678 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.264089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f57f-7141-4470-b2fb-a39096a05678 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.265560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 518/1028] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:35.270449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4a1c-7db1-4e5f-b4f3-9975dbfbba73 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.270732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4a1c-7db1-4e5f-b4f3-9975dbfbba73 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.271011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4a1c-7db1-4e5f-b4f3-9975dbfbba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.289364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-98fa4a1c-7db1-4e5f-b4f3-9975dbfbba73 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:35.290572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98fa4a1c-7db1-4e5f-b4f3-9975dbfbba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:35.317496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.336055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d47c65-6376-4f19-8340-5677360d937d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.361901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 519/1029] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:35.363200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e786-f095-4441-91bb-9be653409e53 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.363509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e786-f095-4441-91bb-9be653409e53 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.363758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e786-f095-4441-91bb-9be653409e53 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.365154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 520/1030] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:35.370460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.371288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.371644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.373148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.373762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.374041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.374315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.375073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:35.375408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.377544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.399137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:35.399137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:35.400031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 511/1031] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:35.406080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.483186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 521/1032] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:35.516641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd080bf-c5f4-4a3c-bc51-cbe5fce26125 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.550243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.550852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.551182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.551457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.562767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.627854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.629344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.631798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.653272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.746594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408917a-a56d-40d3-85ae-921db8894615 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.751555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 512/1033] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:26:35.754306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.783828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.784460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.784747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.785022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.786119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.787613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.789205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 522/1034] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:35.791259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.798922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.863291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c634-e8b5-47f1-a6bf-17b81c274dec None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.885134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:35.898377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.899063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.899365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.899707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] PATH_INFO: `/v3/services/image` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.900278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.901506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167a960-415b-48a2-83a1-4ccb216ef7f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:35.901628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:35.911027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:35.912194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:35.913050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 513/1035] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:35.913995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:35.938667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:35.939419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:35.939701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:35.939975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:35.950863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:35.952350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:35.967712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:35.968924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:35.969890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:35.969890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:35.969890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:35.969890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 523/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:35.970385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.021072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c274-0a08-4b34-95a1-d55d6ae31f28 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.023629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.058574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.059352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.059546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.059826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.060490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.061954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.083184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dd2f-519c-4ab8-89fc-2482aa765102 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.117923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.118537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.118820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.119123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.119762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] RBAC: Adding query filter params (name=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.120074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.122020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.123975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.127471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 524/1037] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:36.129393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.147526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 514/1038] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:26:35 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:36.148448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.263793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bb456-649a-49bf-b1d4-6f5f4a3e6a2b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.294355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38b199-9df0-4484-8cff-4d9d0e181408 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.309907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.310532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.310814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.311105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.311105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.312110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.313451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.333030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 525/1039] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:36.334331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.334959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.335269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.335540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.336177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.336481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.337853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.340263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.344805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 515/1040] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:36.351153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.391576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.416515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.467602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9afc2f-6d95-4e34-bad1-86de3c9da75e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.482922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba96fe-7205-4ec0-a00c-e76eeaf6de4a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.512659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.513324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.513612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.513887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.521218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.522691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.528789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.529408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.529688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.529959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.530673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] RBAC: Adding query filter params (interface=public, service_id=1149e36a5e0e4d48b8b2f009e0b6df79, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.530979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.532408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:36.534651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:36.535574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:36.536525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 526/1041] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:36.541730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.547550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 516/1042] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/endpoints?service_id=1149e36a5e0e4d48b8b2f009e0b6df79&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:36.548471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.672224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1099f-405b-4e29-86c0-b55225d94996 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.672457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.685954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e14a-2622-4679-be41-a54fb3d0c5be None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.695530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:36.710845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.711556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.711835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.712107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.712800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.713104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.715445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.728707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.729504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 527/1043] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:36.729687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.729687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.730456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.730936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.732469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d820fe-db8c-47f5-9d85-102910af976c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.736667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:36.751128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 517/1044] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/services => generated 1957 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:36.868835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaed56a-a450-4b19-a63a-8e58c32b9b93 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:36.913206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:36.913821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:36.914102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:36.914379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:36.915172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] RBAC: Adding query filter params (role.id=a25d390c237843519f5a791c4161536d, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:36.915516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:36.916958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f97d-bbeb-46fa-bca6-3c6433589bbc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:36.926003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 528/1045] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:36 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=a25d390c237843519f5a791c4161536d => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:38.188995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d532-a213-4569-a450-ad4c557e81d7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.189617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d532-a213-4569-a450-ad4c557e81d7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.189617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d532-a213-4569-a450-ad4c557e81d7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.191044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 518/1046] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:38.196626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.197074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.197255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.217339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:38.218542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:38.266992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:38.298362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 529/1047] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:38.566790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81d532-a213-4569-a450-ad4c557e81d7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:38.707945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81d532-a213-4569-a450-ad4c557e81d7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:38.744571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:38.745216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.745527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.745798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.757381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fea0a7d9-d10f-496b-bc8a-c5e8ff00bb2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:38.762100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:38.763193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:38.768215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 519/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:38.769922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:38.785294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae03c-2e88-422a-8088-32a37e64bba3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.785584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae03c-2e88-422a-8088-32a37e64bba3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.785849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae03c-2e88-422a-8088-32a37e64bba3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.787405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 520/1049] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:38.793888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a577-550c-47da-92fd-28f70740e312 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.794165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a577-550c-47da-92fd-28f70740e312 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.794434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a577-550c-47da-92fd-28f70740e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.813289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d005a577-550c-47da-92fd-28f70740e312 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:38.814489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d005a577-550c-47da-92fd-28f70740e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:38.823819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:38.885739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799059-29ed-47d4-9972-5cbc5f1bf800 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:38.889031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 521/1050] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:38.890379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1953-f728-4659-a9c4-8c76992f821c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.890662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1953-f728-4659-a9c4-8c76992f821c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.890934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1953-f728-4659-a9c4-8c76992f821c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.894802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 522/1051] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:38.898295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.898596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.898840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.919198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:38.920426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:38.931171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:38.931796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:38.932392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:38.932673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:38.933568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:38.934053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:38.935506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:38.947285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 530/1052] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:38.951611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:38.992106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.000705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 523/1053] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:39.065384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d5a8-fb7f-4178-bf52-df6639bbab40 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.103355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.103919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.104203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.104480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] PATH_INFO: `/v3/users/f5fecd64ed2a474bae62a367842679eb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.119912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] RBAC: Authorizing `identity:get_user(user_id=f5fecd64ed2a474bae62a367842679eb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.122066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.124045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 531/1054] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:38 2022] GET /identity/v3/users/f5fecd64ed2a474bae62a367842679eb => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:39.130034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.162990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.208563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.242912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610357f0-9521-42da-bef2-cbafa79c1799 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.272354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.280082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f920e3-4074-4bf0-a38e-c5740c51b0db None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.283880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.284501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.284785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.285055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.317788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.318426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.318710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.318988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.319609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.321262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:39.330772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:39.332353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 17:26:39.333249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:39.334490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 532/1055] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:39.335631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.358280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.359704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.431471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.440448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0290ee-4f97-4fae-9388-61a41013cfb2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.466412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 524/1056] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:39.467364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.484183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.484837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.485120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.485400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.496955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:39.501817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:39.503034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:39.503972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 533/1057] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:39.505930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.527730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.574405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af823-0ffa-4f73-8281-720ec84be883 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.612591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.613117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.613402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.613668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.614306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:39.614607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.616035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.618562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d461f45-2f74-448d-b25b-6bbad6581588 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.621761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 525/1058] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:39.622635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.660399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.661944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.662591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.662870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.663211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.664377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.665842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.668068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 534/1059] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:39.668854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.735345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898122-f648-43e8-82a2-c6b5cd03a6dd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.758597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.772508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.773134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.773416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.773688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.774481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:39.774792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.774912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4f3d-1673-4002-950d-0a31fbe0fbbf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.776209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.785688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 526/1060] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:39.786555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.813557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.814175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.814458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.814733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.815414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] RBAC: Adding query filter params (type=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:39.815721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.817107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.822484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 535/1061] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:39.823374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.893276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.897466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345675de-f0f8-4c46-b994-97a459fd7a0f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.931930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa1e3-b4ba-43df-9ef8-888392e4d65d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.934093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.934715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.934997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.935304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.936037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43, user.id=f5fecd64ed2a474bae62a367842679eb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:39.936351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.937813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.943844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 527/1062] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/role_assignments?user.id=f5fecd64ed2a474bae62a367842679eb&scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:39.944687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.973774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.974481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.974698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.974970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.987028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.988589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:40.006394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:40.007518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:40.008585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:40.008585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:40.008585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:40.008585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 536/1063] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:40.014571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:40.018059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:40.070721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798238b-e89c-4388-8032-d1e6697f6834 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.118251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.118861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.119162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.119431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.120088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.121853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.140956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b36f4c-3a4d-43d3-b4fe-0a66d12d7e62 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.176009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.176575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.176857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.177127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.177769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:40.178073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.179483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.191638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 537/1064] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:40.197867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:40.235117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 528/1065] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:40.275003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:40.324335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1845-88f9-42d5-874e-f255f157416f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.371145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.371811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.372094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.372363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.381288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.382872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:40.396128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:40.397216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:40.398545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 538/1066] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:40.404018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:40.426886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:40.518670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b38c-1a34-4151-b9b3-eb74425dd82b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.554365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.555368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.555821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.556245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.557154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:40.557608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.559785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.588610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 529/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:40.590778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:40.704767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03e1a-603d-4154-8f94-fb767f97e74b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.723300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:40.741102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.741742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.742020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.742295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.754763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.756279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:40.771677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:40.772705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:40.781280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:40.781280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:40.781280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:40.781280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 539/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:40.781517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:40.866358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:40.892793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6f5f-fd76-4d5a-a76e-08b94e47aabd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:40.933038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:40.933658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:40.934132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:40.934415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:40.935155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:40.935457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:40.936899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:40.954103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 530/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:40.956037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:41.065522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c41a9-6607-4d91-b921-5a645a867e7d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:41.100282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:41.100913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.101198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.101468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.108939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:41.110385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:41.122202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:41.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:41.124165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:41.127426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 540/1070] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:41.129169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:41.232247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b9f7-dcb7-438a-af22-ddc4c1cacbc9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:41.267803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:41.268443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.268687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.268962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.269654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:41.269961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:41.271414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d758-3f88-41e1-9f8f-bc1b6d1881cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:41.274051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:41.285624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 531/1071] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:41.291588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:41.325391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:41.401185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5132-b043-4636-8e4e-93938bd2a9ab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:41.436980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:41.437644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.437927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.438203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/a25d390c237843519f5a791c4161536d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.440421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=64a58fc0c9a3444a8e5c741204c4dcce, role_id=a25d390c237843519f5a791c4161536d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:41.441858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76308868-bfd7-49f2-99ef-40c37fb0e712 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:41.514521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 541/1072] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:41 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/64a58fc0c9a3444a8e5c741204c4dcce/roles/a25d390c237843519f5a791c4161536d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:41.908142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3db-05cb-4402-8105-4e4c5e524054 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.908335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3db-05cb-4402-8105-4e4c5e524054 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.908595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3db-05cb-4402-8105-4e4c5e524054 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.909953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 532/1073] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:41.915454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ebb9-0170-40a4-8fa1-fef0df3051ed None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.915741 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ebb9-0170-40a4-8fa1-fef0df3051ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.916017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ebb9-0170-40a4-8fa1-fef0df3051ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.935644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cec1ebb9-0170-40a4-8fa1-fef0df3051ed None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:41.936850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cec1ebb9-0170-40a4-8fa1-fef0df3051ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:42.020656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 542/1074] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:42.234968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff10d7-1372-460e-ae3c-f6cb43b318b8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.235286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff10d7-1372-460e-ae3c-f6cb43b318b8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.235464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff10d7-1372-460e-ae3c-f6cb43b318b8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.236862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 533/1075] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:42.242037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.242333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.242613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.263029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:42.264696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:42.281233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:42.294962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff10d7-1372-460e-ae3c-f6cb43b318b8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.341291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 543/1076] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:42.404453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff10d7-1372-460e-ae3c-f6cb43b318b8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:42.439652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:42.440283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.440566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.440831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.451436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:42.455983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:42.456921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:42.457795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:42.459416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 534/1077] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:42.463229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.572233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e995-02e0-4f1a-9cdb-bb09bcc83056 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:42.610329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:42.610934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.611270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.611541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.612199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:42.612500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:42.613860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:42.617105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.624806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 544/1078] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:42.630708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.646402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:42.690114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:42.738434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346697-b957-44ee-8835-12df7fed70e9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:42.750779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854374-46e8-4082-a8e5-c325eda21258 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:42.778128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:42.778766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.779047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.779382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.791666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:42.793146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.793634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.793908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] PATH_INFO: `/v3/users/f5fecd64ed2a474bae62a367842679eb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.795129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=f5fecd64ed2a474bae62a367842679eb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:42.796733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:42.798398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 545/1079] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/users/f5fecd64ed2a474bae62a367842679eb => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:42.804183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.854234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:42.856461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:42.903624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:42.919393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:42.924645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32aaf-5db5-4a0a-a752-b4f44a489cf3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:42.963600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:42.965479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:42.965978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:42.966771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:42.968279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:42.969781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 535/1080] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:26:42.970130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:42.975119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 546/1081] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:42.975548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:42.977461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:43.089789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed245e-6338-4535-9c00-1f0d294f6fed None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:43.093262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa32-7b0c-4526-b5ff-e3c8fd1620fa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:43.128212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:43.129176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.129458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.129732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.133007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:43.133681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.133960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.134232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43/users/f5fecd64ed2a474bae62a367842679eb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.137170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] RBAC: Authorizing `identity:create_grant(project_id=861459d0fc8d41f3ba2ee115d5a5da43, user_id=f5fecd64ed2a474bae62a367842679eb, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:43.138554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ffb09-595c-481f-a991-75ca4f6af87b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:43.141452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:43.143415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:43.159006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:43.173760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:43.174687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:43.174687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:43.174687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:43.174687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 536/1082] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:43.174687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:43.177659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:43.222410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 547/1083] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:42 2022] PUT /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43/users/f5fecd64ed2a474bae62a367842679eb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:43.279075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3ef1-2ddf-4623-8cf8-d706a1b695c9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:43.319691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:43.320663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.320910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.321099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.321749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:43.322054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:43.323512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40d41-8551-422e-821d-c1923b26859d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:43.337011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 537/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:43.646245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509607a-a19b-4a52-9123-adcaa78297c2 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.646757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509607a-a19b-4a52-9123-adcaa78297c2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.646874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509607a-a19b-4a52-9123-adcaa78297c2 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.648331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 548/1085] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:43.653661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.653956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.654236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.673614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:43.674818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:43.739224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:43.744586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 538/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:44.015023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509607a-a19b-4a52-9123-adcaa78297c2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.026136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.123284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509607a-a19b-4a52-9123-adcaa78297c2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.158002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.158631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.158910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.159366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.169658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:44.174307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:44.175283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:44.176191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 549/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:44.181530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.284055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b067a5-38c2-48c6-b987-25911f68dcaf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.318432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.319039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.319347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.319623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.320545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:44.321082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.322216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.331633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 539/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:44.337695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.406807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.443910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfbf0-f86d-4f3d-8e27-6ecf33ccbbf5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.480269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.480900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.481177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.481446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.492007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.493452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:44.508226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:44.509313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:44.510755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:44.510755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:44.510755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:44.510755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 550/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:26:44.515930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.580756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.623680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf5c2-700c-4ccb-acbe-bd2d6b8efe1d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.657605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.658201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.658477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.658745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.659412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:44.659713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.661069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.673039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 540/1090] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:44.678744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.780212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fffe14-1a96-4a7a-bc48-eea7611f6eab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.800246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.815008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.815683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.815969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.816246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.825114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.826572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:26:44.838241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:44.839537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:44.840487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 551/1091] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:44.845480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.947675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0908f-aa5a-437b-9243-8b9ccf73c75e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.969132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.983350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.983969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.984251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.984528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.985252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:44.985672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.987125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510002-16a3-4467-bb8e-30f0f2309992 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.005566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 541/1092] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:45.012273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.116307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5dc47-b6ee-4d59-9598-963221d8f773 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.152466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.153095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.153377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.153653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.187148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bffb45-95ef-4935-adf9-15c9a079db33 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.187442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bffb45-95ef-4935-adf9-15c9a079db33 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.187720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bffb45-95ef-4935-adf9-15c9a079db33 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.189076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 542/1093] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:45.197106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.197385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.197657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.208162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:45.217958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:45.219213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:45.228758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.230596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.289437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 543/1094] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:45.335033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 552/1095] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:45.340782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.445717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a187c-3e43-459e-9d66-6b9269e0a645 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.456168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:45.481559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.482199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.482484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.482833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.493999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.496389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:26:45.513392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:45.514455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:26:45.515968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:26:45.515968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:26:45.515968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:45.515968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 544/1096] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:45.520307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.562885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.608840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:45.629992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7075ab-8306-4c69-8731-033819242961 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.665955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.666562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.667375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.667648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.668388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:45.668693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.668898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ab3e-388c-4920-8c0e-8f84c78b2971 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.670073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.682274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 553/1097] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:45.689019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.707136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.707690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.707958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.708231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.719731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:26:45.724310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:45.725387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:26:45.726251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 545/1098] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:45.732324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.755493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:45.792978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996272-9ed4-4434-8173-d5575623eea9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.829594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.830225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.830499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.830772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.837687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.838237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bf39f-b148-4285-b437-7a47832b12bf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.839913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.842549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:26:45.852243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:26:45.856822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:26:45.857787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 554/1099] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:26:45.860072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.876894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.877901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.878187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.878464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.879193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:45.879502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.880880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.890047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 546/1100] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:45.895800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.970533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15d6d-3e4c-4153-8687-0c3dc56ae7e3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.983305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.003648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c02-e502-4245-9561-95beb2c0d5ee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.012587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.013230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.013512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.013784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.014500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:46.014813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.016329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.036680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 555/1101] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:46.037962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.045325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.045974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.046252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.046523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] PATH_INFO: `/v3/users/f5fecd64ed2a474bae62a367842679eb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.047727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] RBAC: Authorizing `identity:get_user(user_id=f5fecd64ed2a474bae62a367842679eb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.049206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.050894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 547/1102] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/users/f5fecd64ed2a474bae62a367842679eb => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:46.056955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.114420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.161496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27b7b-5e68-4cbc-a905-e169e668df94 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.176574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b761-ab2a-44a6-9391-ee023288680f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.206355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.206973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.207295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.207577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.208315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] RBAC: Adding query filter params (role.id=a25d390c237843519f5a791c4161536d, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=64a58fc0c9a3444a8e5c741204c4dcce) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:46.208656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.210075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.216442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.217051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.217329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.217599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.219295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 556/1103] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:46 2022] GET /identity/v3/role_assignments?user.id=64a58fc0c9a3444a8e5c741204c4dcce&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=a25d390c237843519f5a791c4161536d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:46.240764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.297741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.299362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.407506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 548/1104] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:26:46.413726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.525845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b88d-8593-41ba-a440-7e5d705de4f2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.550126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.561162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.561802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.562077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.562345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.563481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.564918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43b50-6131-4169-8a9d-d16529c7bf13 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.567932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 557/1105] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:46 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:46.573977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.639731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.707709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9cf37-415c-409a-ba15-87aa84dd8c9f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.751588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.752209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.752482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.752753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.753477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43, user.id=f5fecd64ed2a474bae62a367842679eb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:46.753787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.755254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9726b5-1b89-4a2d-932d-dc2e3078c311 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.764397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 549/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:46 2022] GET /identity/v3/role_assignments?user.id=f5fecd64ed2a474bae62a367842679eb&scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:48.803186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c1e-00cd-450b-ab43-6cfd65417be1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:48.803769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c1e-00cd-450b-ab43-6cfd65417be1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:48.803769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176c1e-00cd-450b-ab43-6cfd65417be1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:48.805185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 558/1107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:48.812137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:48.812705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:48.812837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:48.832991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:48.834260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:48.909526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 550/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:49.205154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176c1e-00cd-450b-ab43-6cfd65417be1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:49.314705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176c1e-00cd-450b-ab43-6cfd65417be1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:49.354914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aa942-d582-4ca4-abd7-68cbdc38963a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:49.361926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 559/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:49.367066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:49.420180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:49.486604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc5dc-0fea-45f7-8efa-5df9b4464e24 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:49.542497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:49.543509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:49.543974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:49.544433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:49.545563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:49.548270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a8bf-c350-4285-ba80-8e7c2706a76b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:49.629058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 551/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:26:49 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:51.668620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170290-864d-4042-97c4-1975f0bd0740 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:51.669175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170290-864d-4042-97c4-1975f0bd0740 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:51.669175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170290-864d-4042-97c4-1975f0bd0740 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:51.670520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 560/1111] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:26:51.676321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:51.676845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:51.676970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:51.696428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:51.697650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:51.777242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 552/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:52.062788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92170290-864d-4042-97c4-1975f0bd0740 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.129217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.172856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92170290-864d-4042-97c4-1975f0bd0740 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.208286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.208934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.209216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.209490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] PATH_INFO: `/v3/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.210983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] RBAC: Authorizing `identity:get_role(role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.212464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.214885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 561/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/roles/528d204588504e4a8b4c5fe1294470af => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:52.221063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.253344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.329437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88813a4-f915-4de5-9810-81b948d018ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.368110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.368755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.369036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.369309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] PATH_INFO: `/v3/users/e0dbc97fcdc94009b14a131351bcabd8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.385170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dbc97fcdc94009b14a131351bcabd8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.390220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.390220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 553/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/users/e0dbc97fcdc94009b14a131351bcabd8 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:52.395138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.510015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8e36-02a6-476e-a130-8e83547425b0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.539548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.547551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.548177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.548458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.548732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.621518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.626916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.731662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 562/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:52.738444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.830980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.843122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffd89-e171-4bfd-89cd-4e5aca1c0ef8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.877695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.878336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.878617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.878891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.880075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.881523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f245b-6b15-4637-b4ef-71d5f6737c42 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.883220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 554/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:52.890281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.918627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.995508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b2e0-8b9b-4a5e-834b-15ca62ffba64 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.031633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.032254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.032536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.032810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.033538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43, user.id=e0dbc97fcdc94009b14a131351bcabd8) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:53.033850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.035306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed556fda-0e2d-45f8-9d76-3e4f7680b22d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.041232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 563/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/role_assignments?user.id=e0dbc97fcdc94009b14a131351bcabd8&scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43&role.id=528d204588504e4a8b4c5fe1294470af => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:54.962837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea51d-d045-439c-ae3e-55a199b75cac None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.963497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea51d-d045-439c-ae3e-55a199b75cac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.963497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea51d-d045-439c-ae3e-55a199b75cac None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.964777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 555/1118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:54.970784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.971225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.971371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.989599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:54.990801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:55.057002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 564/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:55.322936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea51d-d045-439c-ae3e-55a199b75cac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.432862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea51d-d045-439c-ae3e-55a199b75cac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.468890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.469526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.469804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.470076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] PATH_INFO: `/v3/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.471578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] RBAC: Authorizing `identity:get_role(role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.472978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.474329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 556/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:55 2022] GET /identity/v3/roles/528d204588504e4a8b4c5fe1294470af => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:55.480849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.505392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.585692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef54cb-cfbb-4514-9341-795f13e65bef None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.621822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.622456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.622734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.623006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] PATH_INFO: `/v3/users/e0dbc97fcdc94009b14a131351bcabd8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.624192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dbc97fcdc94009b14a131351bcabd8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.625630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.627259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 565/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:55 2022] GET /identity/v3/users/e0dbc97fcdc94009b14a131351bcabd8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:55.633281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.662967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.742967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f040-80e6-4004-b151-59f55580280a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.779295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.779941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.780222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.780497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.781663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.783152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660f7df-a840-41ff-a79b-9c94439169c0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.784891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 557/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:55 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:55.791148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.890841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.901420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb38078-46c0-46b3-a563-0d0af5894db2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.941422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.942127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.942409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.942687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43/users/e0dbc97fcdc94009b14a131351bcabd8/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.945202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] RBAC: Authorizing `identity:create_grant(project_id=861459d0fc8d41f3ba2ee115d5a5da43, user_id=e0dbc97fcdc94009b14a131351bcabd8, role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.946653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9caa1c-e7db-400d-aad8-619d43593a38 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:56.004496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 566/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:26:55 2022] PUT /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43/users/e0dbc97fcdc94009b14a131351bcabd8/roles/528d204588504e4a8b4c5fe1294470af => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:57.934833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2132-2b83-40cc-b518-6d7d95434739 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.935490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2132-2b83-40cc-b518-6d7d95434739 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.935490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2132-2b83-40cc-b518-6d7d95434739 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.936673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 558/1124] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:26:57.942104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.942532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.942767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.961526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:57.962914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.032992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 567/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:26:58.300760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c2132-2b83-40cc-b518-6d7d95434739 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.393056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:58.404089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c2132-2b83-40cc-b518-6d7d95434739 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.440033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.440664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.440948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.441221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] PATH_INFO: `/v3/roles/528d204588504e4a8b4c5fe1294470af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.442610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] RBAC: Authorizing `identity:get_role(role_id=528d204588504e4a8b4c5fe1294470af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.444012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.445599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 559/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/roles/528d204588504e4a8b4c5fe1294470af => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:58.452261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.532587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:58.551713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f3fe-9614-4c11-8db1-1178887a2fc8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.586698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.587384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.587667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.587940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] PATH_INFO: `/v3/users/e0dbc97fcdc94009b14a131351bcabd8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.589958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] RBAC: Authorizing `identity:get_user(user_id=e0dbc97fcdc94009b14a131351bcabd8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.591461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.593711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 568/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/users/e0dbc97fcdc94009b14a131351bcabd8 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:58.599700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.701772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f532-d9db-4b4b-8d8c-46a36a3ed458 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.739059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.739696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.739974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.740253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.771485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:58.817560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.818949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.921524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 560/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:26:58.927742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.029463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a17f-d4f4-412c-8eba-4e7f3f757f6f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.065739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.066392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.066670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.066943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] PATH_INFO: `/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.068268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] RBAC: Authorizing `identity:get_project(project_id=861459d0fc8d41f3ba2ee115d5a5da43)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.069909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5567ca-62f0-41ae-a8f6-765f539e6834 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.071658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 569/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/projects/861459d0fc8d41f3ba2ee115d5a5da43 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:59.078749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.140757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.186305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367b88-d098-48dc-86f0-f871761c9e80 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.220465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.221062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.221339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.221607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.222321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] RBAC: Adding query filter params (role.id=528d204588504e4a8b4c5fe1294470af, scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43, user.id=e0dbc97fcdc94009b14a131351bcabd8) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:59.222625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.224076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcc2db-90e0-4bfd-b8b3-0407c46d8347 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.230696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 561/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/role_assignments?user.id=e0dbc97fcdc94009b14a131351bcabd8&scope.project.id=861459d0fc8d41f3ba2ee115d5a5da43&role.id=528d204588504e4a8b4c5fe1294470af => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:01.230505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485009-4025-4302-9c8c-beb426ab4c0e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:01.231070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485009-4025-4302-9c8c-beb426ab4c0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:01.231070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485009-4025-4302-9c8c-beb426ab4c0e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:01.232430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 570/1131] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:01.237907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:01.238365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:01.238487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:01.257349 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:01.258546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:01.327449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 562/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:01.602230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4485009-4025-4302-9c8c-beb426ab4c0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:01.621943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:01.706258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4485009-4025-4302-9c8c-beb426ab4c0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:01.741081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:01.741714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:01.741996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:01.742269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:01.743409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:01.744885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069812-b585-43f6-9b70-6ed3a9446ddb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:01.746481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 571/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:01.752583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:01.807563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:01.852495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf3985-3648-4e15-8279-d5a472592382 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:01.886870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:01.887530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:01.887813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:01.888089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:01.888765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:01.890259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaa8e8-dbe3-42ac-b983-d85d4e38d01c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:01.975317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 563/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:27:01 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:03.942235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608581b-b03a-4900-bfff-3a0a06f80930 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:03.942764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608581b-b03a-4900-bfff-3a0a06f80930 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:03.942764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608581b-b03a-4900-bfff-3a0a06f80930 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:03.944111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 572/1135] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:03.950348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:03.950820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:03.950926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:03.970218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:03.971455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.040744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 564/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:04.317822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608581b-b03a-4900-bfff-3a0a06f80930 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:04.409548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:04.426643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608581b-b03a-4900-bfff-3a0a06f80930 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:04.462643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:04.463967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.464248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.464520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.465687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:04.467172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e26cd-6b47-424d-bb59-b39b289eb54f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:04.468780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 573/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:04.474562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:04.508570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:04.577286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175c69-a54d-4da2-9320-0cc85ddedce1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:04.614190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:04.614799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.615097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.615380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.616035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:04.617467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f4b5-8a0b-450b-8c15-e62f5982186d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:04.702433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 565/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:27:04 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:06.724824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbe6e-cb62-4711-8d20-286c79aa9b9c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:06.725485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbe6e-cb62-4711-8d20-286c79aa9b9c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:06.725485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbe6e-cb62-4711-8d20-286c79aa9b9c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:06.726844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 574/1139] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:27:06.733781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:06.734319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:06.734319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:06.754590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:06.755883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:06.830321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 566/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:07.096557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cbe6e-cb62-4711-8d20-286c79aa9b9c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:07.202624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cbe6e-cb62-4711-8d20-286c79aa9b9c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:07.238744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:07.239426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:07.239710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:07.239985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:07.251624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:07.256385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:07.258174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:07.259946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 575/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:07.264259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:07.291717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:07.371905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e0e37-2f2d-45bd-b504-8afb75abc757 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:07.408682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:07.409336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:07.409619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:07.409891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:07.410570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:07.410876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:07.412302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:07.421591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 567/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:07.427673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:07.443321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:07.532556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f981-384a-4161-ac40-45e19dc1a22d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:07.567347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:07.567993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:07.568275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:07.568551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] PATH_INFO: `/v3/users/031a81342e9c4042b84a2c096cc53a87` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:07.584592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] RBAC: Authorizing `identity:get_user(user_id=031a81342e9c4042b84a2c096cc53a87)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:07.586091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:07.589132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 576/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:07 2022] GET /identity/v3/users/031a81342e9c4042b84a2c096cc53a87 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:07.594706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:07.684817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:07.701996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5a180-ed4e-4d90-bac0-8cad7ddd32ed None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:07.738502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:07.739226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:07.739401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:07.739668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:07.811261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:07.812718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:07.895594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:07.911958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 568/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:27:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:27:07.919098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:07.991699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:08.022326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1469-be50-4458-865c-6dcb89df83dd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:08.066242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:08.066879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:08.067182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:08.067455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] PATH_INFO: `/v3/projects/ad5e2869b265421c91f0cb684f90820d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:08.068581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] RBAC: Authorizing `identity:get_project(project_id=ad5e2869b265421c91f0cb684f90820d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:08.070266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9698c8c-b030-4430-a25c-8de2996a7a47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:08.071938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 577/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:07 2022] GET /identity/v3/projects/ad5e2869b265421c91f0cb684f90820d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:08.078384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:08.178660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44e4ba-5d04-4645-b0e3-6c09cf54a843 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:08.214061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:08.214664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:08.214942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:08.215240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:08.215962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=ad5e2869b265421c91f0cb684f90820d, user.id=031a81342e9c4042b84a2c096cc53a87) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:08.216268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:08.217689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb18e8-af00-4186-a072-7d7a30f8c988 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:08.223431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 569/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:27:08 2022] GET /identity/v3/role_assignments?user.id=031a81342e9c4042b84a2c096cc53a87&scope.project.id=ad5e2869b265421c91f0cb684f90820d&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:10.135431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145df8-a360-4c76-a8ed-27b4af7b30ef None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:10.136267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145df8-a360-4c76-a8ed-27b4af7b30ef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:10.136267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145df8-a360-4c76-a8ed-27b4af7b30ef None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:10.137306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 578/1147] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:10.143017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:10.143569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:10.143661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:10.162468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:10.163765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:10.210432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:10.235580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 570/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:10.504856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145df8-a360-4c76-a8ed-27b4af7b30ef None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:10.611071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145df8-a360-4c76-a8ed-27b4af7b30ef None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:10.649726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:10.650608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:10.650962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:10.651269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:10.659127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:10.663545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:10.669057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:10.671115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:10.672772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 579/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:10.676703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:10.782795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47dd3a-8b26-49ee-8a4b-c71ac52c74d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:10.817750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:10.818352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:10.818635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:10.818909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:10.819855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:10.820162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:10.821532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:10.830918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 571/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:10.837011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:10.937905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2129dd-96ab-45a0-b52e-0a1713073d58 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:10.972265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:10.972891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:10.973165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:10.973436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] PATH_INFO: `/v3/users/031a81342e9c4042b84a2c096cc53a87` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:10.974572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] RBAC: Authorizing `identity:get_user(user_id=031a81342e9c4042b84a2c096cc53a87)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:10.976032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:10.977632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 580/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:10 2022] GET /identity/v3/users/031a81342e9c4042b84a2c096cc53a87 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:10.984165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:11.031240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:11.098439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d64d0-9c1b-47a5-b9d7-8938e4446d0f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:11.135399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:11.136038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:11.136319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:11.136593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] PATH_INFO: `/v3/projects/ad5e2869b265421c91f0cb684f90820d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:11.137732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] RBAC: Authorizing `identity:get_project(project_id=ad5e2869b265421c91f0cb684f90820d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:11.139210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1e11-40e7-4557-bd08-b3f01ef0252f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:11.140878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 572/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:10 2022] GET /identity/v3/projects/ad5e2869b265421c91f0cb684f90820d => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:11.147116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:11.216268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:11.251700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfed6-6f40-4476-a1e4-f42a8babadc4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:11.285483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:11.286153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:11.286432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:11.286704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] PATH_INFO: `/v3/projects/ad5e2869b265421c91f0cb684f90820d/users/031a81342e9c4042b84a2c096cc53a87/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:11.288656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad5e2869b265421c91f0cb684f90820d, user_id=031a81342e9c4042b84a2c096cc53a87, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:11.290099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9ace-8a6c-43be-ba52-284f1672e779 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:11.392527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 581/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:27:11 2022] PUT /identity/v3/projects/ad5e2869b265421c91f0cb684f90820d/users/031a81342e9c4042b84a2c096cc53a87/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:13.314167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b887163-77e0-488a-bc97-faabe837b358 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:13.314748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b887163-77e0-488a-bc97-faabe837b358 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:13.314748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b887163-77e0-488a-bc97-faabe837b358 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:13.316121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 573/1154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:13.321700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:13.322172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:13.322342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:13.341019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:13.342253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:13.412683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 582/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:13.677040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b887163-77e0-488a-bc97-faabe837b358 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:13.784475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b887163-77e0-488a-bc97-faabe837b358 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:13.795546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:13.821527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:13.822520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:13.822804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:13.823320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:13.835855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:13.841228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:13.842365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:27:13.844228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 574/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:13.848587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:13.909826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:13.961798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21486-bbaf-42c4-9086-6a8a6e1f309b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:14.007128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:14.007732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:14.008017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:14.008291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:14.008978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:14.009285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:14.011320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:14.020313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 583/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:14.027373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:14.133189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67849-b64d-401f-9ecc-2b6e798b4909 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:14.168000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:14.168636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:14.168916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:14.169188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] PATH_INFO: `/v3/users/031a81342e9c4042b84a2c096cc53a87` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:14.170321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] RBAC: Authorizing `identity:get_user(user_id=031a81342e9c4042b84a2c096cc53a87)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:14.171810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:14.173433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 575/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:14 2022] GET /identity/v3/users/031a81342e9c4042b84a2c096cc53a87 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:14.179615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:14.284410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e896eb3-c50c-42a8-8a77-9516d2dfbb3d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:14.302582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:14.320482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:14.321097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:14.321373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:14.321641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:14.395613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:14.396984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:14.503744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 584/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:27:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:27:14.510445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:14.550144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:14.623275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1a8ef-4d3c-4e74-8269-1afc709bdf09 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:14.659184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:14.659740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:14.660023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:14.660301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] PATH_INFO: `/v3/projects/ad5e2869b265421c91f0cb684f90820d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:14.661423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] RBAC: Authorizing `identity:get_project(project_id=ad5e2869b265421c91f0cb684f90820d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:14.662917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602632-a518-46b1-87b6-59b4d2fd8e32 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:14.664619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 576/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:14 2022] GET /identity/v3/projects/ad5e2869b265421c91f0cb684f90820d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:14.671106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:14.690570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:14.784669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a8ef7-0acb-4147-8557-64a0b9766d37 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:14.820425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:14.821030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:14.821313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:14.821589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:14.822354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=ad5e2869b265421c91f0cb684f90820d, user.id=031a81342e9c4042b84a2c096cc53a87) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:14.822858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:14.824338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778dc06-3fe4-42e7-96e9-543f9abbeb2e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:14.830433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 585/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:27:14 2022] GET /identity/v3/role_assignments?user.id=031a81342e9c4042b84a2c096cc53a87&scope.project.id=ad5e2869b265421c91f0cb684f90820d&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:16.782911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526161-29dd-4c29-835c-eb918fe1546f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:16.783589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526161-29dd-4c29-835c-eb918fe1546f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:16.783684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526161-29dd-4c29-835c-eb918fe1546f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:16.785085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 577/1162] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:16.791960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:16.792512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:16.792512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:16.812857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:16.814096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:16.892421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 586/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:17.166005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526161-29dd-4c29-835c-eb918fe1546f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:17.267745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526161-29dd-4c29-835c-eb918fe1546f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:17.270092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:17.301896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:17.302501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:17.302838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:17.303129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:17.377767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:17.379262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:17.484926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 578/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:27:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:27:17.491105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:17.506644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:17.597581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db835ce4-d868-4363-acae-131023ea2f00 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:17.633854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:17.634740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:17.635048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:17.635356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:17.642480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:17.644096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d5d1205a-9eab-4eae-9f26-5bea17059f9e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:17.661382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:17.662663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:17.663581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 587/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:27:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:17.670096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:17.673493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:17.778519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd873-4e28-4dae-bf85-e9e744e78d54 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:17.813778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:17.814460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:17.814637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:17.814908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:17.815575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:17.815868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:17.817225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd88ad-021b-4b21-a7a7-05cf645e88a3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:17.825504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 579/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 17:27:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:19.775366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5ee2-6ba5-4363-99fc-8bf952ca3103 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:19.775921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5ee2-6ba5-4363-99fc-8bf952ca3103 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:19.776017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5ee2-6ba5-4363-99fc-8bf952ca3103 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:19.777403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 588/1167] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:19.783269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e8-2f11-4496-b8da-6e534b5f1313 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:19.783779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e8-2f11-4496-b8da-6e534b5f1313 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:19.783870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e8-2f11-4496-b8da-6e534b5f1313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:19.802826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a3c18e8-2f11-4496-b8da-6e534b5f1313 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:19.804079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a3c18e8-2f11-4496-b8da-6e534b5f1313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:19.871582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:19.877126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 580/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:20.179962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5ee2-6ba5-4363-99fc-8bf952ca3103 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.279847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:20.317018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5ee2-6ba5-4363-99fc-8bf952ca3103 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.356243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdee062-3465-456c-ad01-b38956328292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.356856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee062-3465-456c-ad01-b38956328292 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.357134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee062-3465-456c-ad01-b38956328292 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.357407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee062-3465-456c-ad01-b38956328292 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.358071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee062-3465-456c-ad01-b38956328292 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.359485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee062-3465-456c-ad01-b38956328292 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.446452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 589/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Aug 24 17:27:20 2022] POST /identity/v3/domains => generated 267 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:22.504940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffdd87-7d71-4504-bcb9-cb80e4c64930 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.505545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffdd87-7d71-4504-bcb9-cb80e4c64930 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.505545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffdd87-7d71-4504-bcb9-cb80e4c64930 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.506856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 581/1170] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:22.513667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.514190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.514289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.533573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:22.534802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.611746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 590/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:27:22.884973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffdd87-7d71-4504-bcb9-cb80e4c64930 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.998336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffdd87-7d71-4504-bcb9-cb80e4c64930 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.035060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.035720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.035993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.036261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] PATH_INFO: `/v3/domains/9fdb96f82b584919a8b03c92c32fb0b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.048677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9fdb96f82b584919a8b03c92c32fb0b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.050127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f0bd-3d2c-4d59-ac5a-23abd7acf044 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.051856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 582/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/domains/9fdb96f82b584919a8b03c92c32fb0b3 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:27:23.058792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.125834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:23.166805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276667ad-39e3-444e-859e-8a250d9c959b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.203454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.204079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.204368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.204638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.205299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.206745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89140b-3817-4171-83bc-dfbfab2d6ddc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.300582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 591/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:25.308437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16944-9eb0-4078-8824-a03b9b98f180 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.309009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16944-9eb0-4078-8824-a03b9b98f180 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.309009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16944-9eb0-4078-8824-a03b9b98f180 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.310310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 583/1174] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:25.315646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.316038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.316191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.334191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:25.335399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:25.404852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 592/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:25.675999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e16944-9eb0-4078-8824-a03b9b98f180 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:25.735322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:25.777122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e16944-9eb0-4078-8824-a03b9b98f180 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:25.810774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:25.811447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.811724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.811994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] PATH_INFO: `/v3/domains/9fdb96f82b584919a8b03c92c32fb0b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.813121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=9fdb96f82b584919a8b03c92c32fb0b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:25.814551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f70d7-e8db-4f34-977b-7c4f7439b2fe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:25.816162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 584/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 17:27:25 2022] GET /identity/v3/domains/9fdb96f82b584919a8b03c92c32fb0b3 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:25.825090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:25.872014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:25.928148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bdad3-fa51-46f2-bf83-e74123067180 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:25.965101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:25.965723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.966011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.966286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.966938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:25.968428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28e7f-e1c7-4ac3-b3dc-bcc9d83db79a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.043765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 593/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:27:25 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:28.029179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74003d-7454-4645-a6f6-ade08e136ef2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.029728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74003d-7454-4645-a6f6-ade08e136ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.029728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74003d-7454-4645-a6f6-ade08e136ef2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.031056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 585/1178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:28.036334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.036801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.036894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.056565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:28.057771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:28.125410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 594/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:28.395420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74003d-7454-4645-a6f6-ade08e136ef2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.552300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74003d-7454-4645-a6f6-ade08e136ef2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.580316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:28.590010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.590707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.590948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.591257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.603330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:28.608015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:28.609192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:27:28.610271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 586/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:28.615299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.647411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:28.723320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafa217-fcaa-464e-b90b-a16bb8fbc1bd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.757779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.758392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.758672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.759539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.760294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:28.760599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.761979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.770485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 595/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:28.776552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.882357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a441a-ae72-44b0-8f06-1ea858914e54 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.917581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.918129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.918407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.918678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] PATH_INFO: `/v3/users/82bdd07d90304790929b99c15c52a364` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.933290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] RBAC: Authorizing `identity:get_user(user_id=82bdd07d90304790929b99c15c52a364)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.934759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.936570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 587/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/users/82bdd07d90304790929b99c15c52a364 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:28.942519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.040608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:29.049612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d470-1510-4280-b85b-5a357a655bbe None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:29.084437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:29.085050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.085334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.085609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.154716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:29.156213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:29.246665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:29.255973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 596/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:27:29.262830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.309353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:29.363637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873af8e-2a7e-4499-869c-499def4ac2fa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:29.397199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:29.397828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.398108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.398382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] PATH_INFO: `/v3/projects/6a4df5f79c21424fae19195d4710b046` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.399675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] RBAC: Authorizing `identity:get_project(project_id=6a4df5f79c21424fae19195d4710b046)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:29.401228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629589c9-f157-4e09-b023-af7c89c95fbf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:29.402865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 588/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:29 2022] GET /identity/v3/projects/6a4df5f79c21424fae19195d4710b046 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:29.409056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.507840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0bd32-2a96-4e34-b24a-5d783df10c46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:29.544028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:29.544634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.544910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.545177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.545899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=6a4df5f79c21424fae19195d4710b046, user.id=82bdd07d90304790929b99c15c52a364) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:29.546203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:29.547663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf76176-3184-47bd-b080-36f121b528d9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:29.553247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 597/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:27:29 2022] GET /identity/v3/role_assignments?user.id=82bdd07d90304790929b99c15c52a364&scope.project.id=6a4df5f79c21424fae19195d4710b046&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:31.466783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4796-6e12-458a-9d23-5d1556c1b5f7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:31.467364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4796-6e12-458a-9d23-5d1556c1b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:31.467364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4796-6e12-458a-9d23-5d1556c1b5f7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:31.468762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 589/1186] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:31.474879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:31.475424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:31.475506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:31.494982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:31.496238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:31.548545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:31.564876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 598/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:31.834408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc4796-6e12-458a-9d23-5d1556c1b5f7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:31.943106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc4796-6e12-458a-9d23-5d1556c1b5f7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:31.957614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:31.980400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:31.981039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:31.981317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:31.981587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:31.992491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:31.997281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:31.998424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:27:31.999460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 590/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:32.004482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:32.106183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb192-c09f-4a20-bbb5-9dd9febebec4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.141159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.141764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.142044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.142316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.142994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:32.143308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.144677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.154148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 599/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:32.160003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:32.262713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa6cb-b1d2-4c57-b47f-c5af74831d61 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.298213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.298844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.299147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.299418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] PATH_INFO: `/v3/users/82bdd07d90304790929b99c15c52a364` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.300557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] RBAC: Authorizing `identity:get_user(user_id=82bdd07d90304790929b99c15c52a364)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.302003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.303612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 591/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:32 2022] GET /identity/v3/users/82bdd07d90304790929b99c15c52a364 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:32.309760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:32.360571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:32.410975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08285-9670-4aee-937c-2032823f93d7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.445423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.446580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.446865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.447166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] PATH_INFO: `/v3/projects/6a4df5f79c21424fae19195d4710b046` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.448404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4df5f79c21424fae19195d4710b046)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.449832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d14c45-479f-4a43-ba2e-cffdd707d2b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.451600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 600/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:32 2022] GET /identity/v3/projects/6a4df5f79c21424fae19195d4710b046 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:32.457743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:32.500376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:32.558936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf4ee7-ea1e-4d84-b7f8-616ac2db8652 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.594956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.595658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.595940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.596215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] PATH_INFO: `/v3/projects/6a4df5f79c21424fae19195d4710b046/users/82bdd07d90304790929b99c15c52a364/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.598122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4df5f79c21424fae19195d4710b046, user_id=82bdd07d90304790929b99c15c52a364, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.599609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4a79-71d3-45e0-907a-e39572521101 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.681596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 592/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:27:32 2022] PUT /identity/v3/projects/6a4df5f79c21424fae19195d4710b046/users/82bdd07d90304790929b99c15c52a364/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:34.569980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818255-398b-461d-822b-42a76f7f34f9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.570517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818255-398b-461d-822b-42a76f7f34f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.570517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818255-398b-461d-822b-42a76f7f34f9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.572636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 601/1193] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:27:34.578062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.578513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.578613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.597153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:34.598369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:34.663773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 593/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:27:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:27:34.934240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818255-398b-461d-822b-42a76f7f34f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.036910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818255-398b-461d-822b-42a76f7f34f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.056159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.076765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.077421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.077703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.077978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.090904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:27:35.095690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:27:35.096887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:27:35.098015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 602/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:27:35.103629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.134923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.205882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087129-4bd9-45dc-90d2-c83a50e22c6b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.240021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.240629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.240908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.241181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.241841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:35.242139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.244139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.252297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 594/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:35.258234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.358347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a43b-a8c9-49f8-8bdc-d8f5fe7091f2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.392297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.393903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.393903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.393903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] PATH_INFO: `/v3/users/82bdd07d90304790929b99c15c52a364` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.394551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] RBAC: Authorizing `identity:get_user(user_id=82bdd07d90304790929b99c15c52a364)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.396009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.397600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 603/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/users/82bdd07d90304790929b99c15c52a364 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:35.403777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.497117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.505787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45431893-9ae8-4bee-9e07-93fe2ee8f68f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.539724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.540457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.540609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.540882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.609651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.611139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.703364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.713044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 595/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:27:35.719296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.768104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.823384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73e4e-5af4-4c39-a490-dadb61e4d595 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.859240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.859877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.860156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.860431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] PATH_INFO: `/v3/projects/6a4df5f79c21424fae19195d4710b046` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.861553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4df5f79c21424fae19195d4710b046)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.862996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ab0f-40b7-4cf1-8590-f32587e67494 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.864713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 604/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/projects/6a4df5f79c21424fae19195d4710b046 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:35.871962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.978869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f976114-064e-4545-8db3-e8151e16ece9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:36.013263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:36.013869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:36.014148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:36.014422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:36.015167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=6a4df5f79c21424fae19195d4710b046, user.id=82bdd07d90304790929b99c15c52a364) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:36.015477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:36.016913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29129f7-0712-4679-9aa3-539d45a9c843 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:36.022838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 596/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/role_assignments?user.id=82bdd07d90304790929b99c15c52a364&scope.project.id=6a4df5f79c21424fae19195d4710b046&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:45.854935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=44 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:46.020115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=72 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:50.929971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3bb2-21ec-4e5b-b57b-91724e402574 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:50.930539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3bb2-21ec-4e5b-b57b-91724e402574 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:50.930539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3bb2-21ec-4e5b-b57b-91724e402574 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:50.931949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 605/1201] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:28:50.938957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:50.939520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:50.939520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:50.959795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:28:50.961307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:51.039441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 597/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:28:51.313174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc3bb2-21ec-4e5b-b57b-91724e402574 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:51.436391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc3bb2-21ec-4e5b-b57b-91724e402574 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:51.474518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:51.475177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:51.475454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:51.475724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:51.487625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:51.489819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:28:51.504881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:51.506170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:28:51.507298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:28:51.507298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:51.507298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:28:51.507298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 606/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:51.514014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:51.649459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f893a6f-837e-4767-bf49-e021db342225 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:51.702469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:51.709731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:51.710388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:51.713968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:51.713968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:51.713968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:51.713968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:51.714452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c192404-55be-4d94-8367-7d810f53c9f5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:51.727877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 598/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:28:51.734732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:51.797912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:51.854803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1328238-d5d0-4063-9945-2e1f3cd3b632 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:51.892509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:51.893194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:51.893513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:51.893918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:51.894672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:51.896294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59afa-5ed2-475f-bf24-189e463107a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:52.070788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 607/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 17:28:51 2022] POST /identity/v3/users => generated 251 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:28:54.167742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33690f8-d12c-4a00-a8a8-f92792281b2a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:54.168580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33690f8-d12c-4a00-a8a8-f92792281b2a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:54.168580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33690f8-d12c-4a00-a8a8-f92792281b2a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:54.169741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 599/1206] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:28:54.175935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:54.176469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:54.176573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:54.196846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:28:54.198619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:54.276582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 608/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:28:54.571469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33690f8-d12c-4a00-a8a8-f92792281b2a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:54.687503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33690f8-d12c-4a00-a8a8-f92792281b2a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:54.727052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:54.728119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:54.729086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:54.730469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:54.751178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:28:54.762243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:54.763670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:28:54.765015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:28:54.766062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 600/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:54.774420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:54.854707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:54.920975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd110-5035-4190-aa98-319d4e068e45 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:54.959794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:54.960519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:54.960837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:54.961149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:54.961946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:54.962293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:54.964554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:54.974831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 609/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:28:54.985058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:55.042529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:55.099374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f22a5-834c-4c0e-bec7-c584119ec0ec None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:55.136979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:55.137535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:55.137816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:55.138089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:55.152042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:55.154938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:28:55.169626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:55.171964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:28:55.173707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:28:55.173707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:55.173707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:28:55.175279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 601/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:55.179030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:55.292448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:55.295728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069008-6943-436e-9383-4453c10c17b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:55.334217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:55.334895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:55.335247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:55.335570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:55.336637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:55.337006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:55.339279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:55.364732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 610/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:28:55.370950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:55.496562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556386-e72a-49a8-800c-2cdc3a3fecba None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:55.498231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:55.544879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:55.545882 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:55.546315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:55.546736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:55.561391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:55.563948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:28:55.586110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:55.588344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:28:55.593356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 602/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:55.595395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:55.733342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ad1f-9765-4540-a77c-57c2068058ba None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:55.776273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:55.776709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:55.777151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:55.777441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:55.778194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:55.778504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:55.779992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:55.800530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 611/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:28:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:28:55.806729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:55.919101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d49b-02c5-4142-9435-93a52a5e9383 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:55.958843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:55.959755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:55.960124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:55.960483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:55.994957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:56.035234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:56.036620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:56.151201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 603/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:28:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:28:56.154667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:56.175474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:56.270778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c073d-67a9-4fd9-a132-2ef7e7abf971 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:56.315372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:56.315926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:56.316453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:56.316727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:56.328069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:56.329582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:28:56.346806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:56.348883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:28:56.350517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:28:56.350517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:28:56.350517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:28:56.350517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 612/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:56.354864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:56.447317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:56.501404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c17f3-be92-4f53-a66d-1019b32ac17a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:56.548584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:56.549270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:56.549605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:56.549922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:56.550609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:56.550954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:56.552562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:56.566755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 604/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:28:56.576138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:56.671898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:56.712093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe519cd-54fb-42aa-a35a-f64be6dff4a3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:56.754221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771de23-b688-4f61-9507-200f1888826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:56.754875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771de23-b688-4f61-9507-200f1888826b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:56.755192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771de23-b688-4f61-9507-200f1888826b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:56.755472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771de23-b688-4f61-9507-200f1888826b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:56.764556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771de23-b688-4f61-9507-200f1888826b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:56.766232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771de23-b688-4f61-9507-200f1888826b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a771de23-b688-4f61-9507-200f1888826b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:28:56.780419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:56.782301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:28:56.784449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 613/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:56.788024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:56.917913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17aa9-f19b-4f71-9d8e-15a00c92eb7a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:56.960774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:56.982109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:56.983198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:56.983706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:56.984205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:56.985514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:56.986076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:56.988892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f7b0-71f3-483e-8391-a3cd52daff6f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:57.012044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 605/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:28:57.018815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771de23-b688-4f61-9507-200f1888826b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:57.140983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771de23-b688-4f61-9507-200f1888826b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:57.175115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:57.181450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:57.182967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:57.183429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:57.183790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:57.184583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=f1b1de8ca7b349ad98880b604d1cb6cb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:57.184960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:57.186612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b6b8-4074-4254-9443-2c77f9dd7fc2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:57.193232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 614/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:28:57 2022] GET /identity/v3/role_assignments?user.id=f1b1de8ca7b349ad98880b604d1cb6cb&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:28:59.200304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3ba9-d702-4b36-a6cf-e6afeec997dc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:59.200860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3ba9-d702-4b36-a6cf-e6afeec997dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:59.200990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3ba9-d702-4b36-a6cf-e6afeec997dc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:59.202422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 606/1220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:28:59.210882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:59.211475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:59.211475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:59.233697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:28:59.234929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:59.352172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 615/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:28:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:28:59.633079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3ba9-d702-4b36-a6cf-e6afeec997dc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:59.760421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3ba9-d702-4b36-a6cf-e6afeec997dc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:59.797845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:59.798471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:59.798819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:59.799135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:59.811346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:28:59.816298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:28:59.818414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:28:59.819707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 607/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:28:59.824351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:59.936611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d8df-bc3d-49f6-bd08-edda3e102df5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:59.969247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:59.981772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:59.982527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:59.982809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:59.983128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:59.984015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:28:59.984377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:59.985822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:59.996059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 616/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:00.002215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:00.052211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:00.117371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a46-c11f-47c7-b87c-efb1f9fbec67 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:00.155737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:00.156425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:00.156710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:00.156990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:00.169102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:00.170639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:00.188362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:00.190104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:00.192158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:00.192158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:00.192158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:00.192158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 608/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:00.197718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:00.334513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3781b-d7b8-46cc-bb70-08cef9e44b45 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:00.372282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:00.372908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:00.373196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:00.373474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:00.374129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:00.374439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:00.375955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:00.390408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 617/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:00.399793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:00.512557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:00.519389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239656-88e4-4327-946e-e8af8c3ec4b9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:00.559524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:00.560309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:00.560680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:00.561043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:00.570575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:00.574783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:29:00.594501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:00.596302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:00.598087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 609/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:00.602030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:00.682077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:00.758120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055ca6-03ab-4a34-82fa-f326302df641 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:00.795915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:00.796452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:00.796743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:00.797015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:00.797749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:00.798062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:00.799546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:00.820620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 618/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:29:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:00.830947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:00.946520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b5db5-3a9d-4d6a-a0eb-2a2b7327b6be None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:00.985007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:00.985716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:00.986045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:00.986364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:00.999385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:01.000861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:01.016684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:01.018564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:01.020670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:01.020670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:01.020670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:01.020670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 610/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:01.025464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:01.143358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2debad2-b552-494d-bd5e-7c2f85c3727e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:01.146421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:01.184312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:01.184939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:01.185224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:01.185500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:01.186150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:01.186454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:01.187902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:01.201423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 619/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:01.210348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:01.222191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:01.319409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004767a-c45d-4677-ad47-1ebf02ca0476 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:01.356530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:01.357181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:01.357463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:01.357737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:01.365264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:01.370029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:29:01.379807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:01.381498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:01.383258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 611/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:01.387427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:01.501044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ad0-adfb-4ec6-8910-e1b4d99e06c8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:01.539592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:01.540216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:01.540498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:01.541298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:01.542011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:01.542323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:01.543881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8df95-5f1a-4e69-ac74-5dc8f55154b6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:01.558016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 620/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:01.564827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:01.664106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:01.711391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39c2a8-5b27-4351-bd48-8e81e2334972 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:01.748088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:01.748805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:01.749086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:01.749363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/f1b1de8ca7b349ad98880b604d1cb6cb/roles/7b3e6b63364c450bac66bd3642e5a134` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:01.766837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=f1b1de8ca7b349ad98880b604d1cb6cb, role_id=7b3e6b63364c450bac66bd3642e5a134)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:01.769183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d3dd-a16b-4c92-8aa2-67a5a6ab742f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:01.915049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 612/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:29:01 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/f1b1de8ca7b349ad98880b604d1cb6cb/roles/7b3e6b63364c450bac66bd3642e5a134 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:29:03.888910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1cd6-ec4d-4ae0-a5f6-20eb94ba14de None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:03.889586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1cd6-ec4d-4ae0-a5f6-20eb94ba14de None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:03.889586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1cd6-ec4d-4ae0-a5f6-20eb94ba14de None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:03.890856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 621/1233] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:29:03.896995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:03.897832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:03.897832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:03.917580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:03.918821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:04.019441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 613/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:29:04.304162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1cd6-ec4d-4ae0-a5f6-20eb94ba14de None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:04.334605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:04.433025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1cd6-ec4d-4ae0-a5f6-20eb94ba14de None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:04.494644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:04.495905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:04.496396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:04.496894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:04.517634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:29:04.528162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:04.529408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:04.530414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 622/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 17:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:04.537921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:04.609745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:04.671175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54369b80-bbba-4f01-9633-912be3841aa2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:04.710886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:04.711535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:04.711814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:04.712085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:04.713389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:04.713720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:04.715175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:04.724278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 614/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 17:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:04.732136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:04.830633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:04.858757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404e1d-f157-493f-96f5-33f803b70161 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:04.920606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:04.921667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:04.922187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:04.922637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:04.942767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:04.945480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:04.973631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:04.974850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:04.975943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:04.975943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:04.975943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:04.975943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 623/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:29:04.982937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:05.105114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301ce49-b37c-4669-a13b-9f7cd8ea897b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:05.116243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:05.146096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:05.146714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:05.146994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:05.147318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:05.147979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:05.148285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:05.149671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:05.163929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 615/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:05.170952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:05.282085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a63aa-c03d-42d0-bd6a-e528b3a3a43c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:05.320496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:05.321173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:05.321456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:05.321732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:05.325063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:05.331509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:05.332993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:29:05.346068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:05.347827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:05.349789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 624/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:05.355901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:05.469801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e124-b21d-424c-865c-9a4d8d5572a1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:05.507959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:05.508618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:05.508899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:05.509181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:05.510805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:05.511049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:05.512566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:05.532229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 616/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:29:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:05.538335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:05.654785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b692-3f3f-4b1a-9ed5-e502a3f16791 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:05.691854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:05.692454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:05.692734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:05.692991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:05.758799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:05.765882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:05.767379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:05.871960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 625/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:29:05.878289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:05.908621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:05.990190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b852-5d3e-4278-a39b-3257b58a9360 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:06.027528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:06.028075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:06.028354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:06.028628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:06.038905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:06.040387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:06.055399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:06.056811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:06.057992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:06.057992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:06.057992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:06.057992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 617/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:06.062799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:06.168647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:06.174438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66928e76-7128-4bb4-9523-09f433ceff99 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:06.210507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:06.211140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:06.211439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:06.211709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:06.212383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:06.212706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:06.214087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:06.226361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 626/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:06.232585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:06.323355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:06.346634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee11e8f-07dd-4392-9120-802d5b820867 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:06.386337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:06.386978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:06.387288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:06.387622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:06.394579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:06.396057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:29:06.407419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:06.408961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:06.410261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 618/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:06.414639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:06.521895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e85fa-9681-4867-90f1-19e85f23287e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:06.557899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:06.558566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:06.558899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:06.559147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:06.559852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:06.560159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:06.561597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581b17b-9431-497e-9841-cd0dbc96f08f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:06.576165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 627/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:06.583351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:06.710296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabbd91-f479-462c-9ba1-5e20dc648017 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:06.756655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:06.757309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:06.757598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:06.757866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:06.758638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] RBAC: Adding query filter params (role.id=7b3e6b63364c450bac66bd3642e5a134, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=f1b1de8ca7b349ad98880b604d1cb6cb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:06.758998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:06.760648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c543dc-773a-4f61-bd8e-12155cd106e3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:06.768104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 619/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:29:06 2022] GET /identity/v3/role_assignments?user.id=f1b1de8ca7b349ad98880b604d1cb6cb&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=7b3e6b63364c450bac66bd3642e5a134 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:08.842600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667f2f-a9e1-4791-98e8-99222fb602b4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:08.843284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667f2f-a9e1-4791-98e8-99222fb602b4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:08.843284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667f2f-a9e1-4791-98e8-99222fb602b4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:08.844687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 628/1247] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:29:08.850627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:08.851112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:08.851303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:08.858625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:08.871808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:08.873068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:08.976716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 620/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:29:09.249682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667f2f-a9e1-4791-98e8-99222fb602b4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:09.268908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:09.359811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667f2f-a9e1-4791-98e8-99222fb602b4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:09.398090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:09.398720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:09.399024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:09.401069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:09.410035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:29:09.414874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:09.416659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:09.418218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 629/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:29:09.425412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:09.540118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0d2d1-628c-443f-b74a-39a390e3453b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:09.575931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:09.581393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:09.582043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:09.582320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:09.582689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:09.583406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:09.586314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:09.586314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:09.594934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 621/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:09.601066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:09.693709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:09.719328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330b7d-5c0d-40c2-a537-406c11c25d0f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:09.757031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:09.757743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:09.758072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:09.758415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:09.771023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:09.772588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:09.788968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:09.790908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:09.792661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:09.792661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:09.792661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:09.792661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 630/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:09.796969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:09.912971 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650ec83-b78c-4be6-b235-0e296ad16401 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:09.949439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:09.950052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:09.950330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:09.950610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:09.951290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:09.951594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:09.953000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:09.967899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 622/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:09.974281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:10.103799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcb20-737f-4fdf-9e21-cba52ae0b694 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:10.136882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:10.145275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:10.145926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:10.146210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:10.146484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:10.155285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:10.156767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:29:10.169411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:10.171597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:10.173589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 631/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:10.176811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:10.245065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:10.294801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06af3a-ae27-497a-8482-a175f1f5feb8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:10.331499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:10.333209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:10.333209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:10.333209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:10.333561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:10.333772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:10.335270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:10.363797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 623/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:29:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:10.364038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:10.533368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3895a-0495-4a24-8628-d71f15f90d6f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:10.599627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:10.600660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:10.601116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:10.601565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:10.700612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:10.716029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:10.717614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:10.832657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 632/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:29:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:29:10.839773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:10.954206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664319-3513-4f87-8586-21cb3b4744d1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:10.970984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:10.997236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:10.997896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:10.998181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:10.998455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:11.010386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:11.012015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:11.029237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:11.031186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:11.033264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:11.033264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:11.033264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:11.033264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 624/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:11.038048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:11.148060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:11.161618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a691d1-d6d9-4a84-ae19-ec53510ca74d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:11.199153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:11.199916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:11.200289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:11.200660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:11.201404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:11.201807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:11.203411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:11.217681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 633/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:11.226774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:11.340939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5ffdb-c283-4c08-907c-e7891685393b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:11.379174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:11.379880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:11.380173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:11.380450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:11.389011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:11.390507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:29:11.403435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:11.410481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:11.411831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 625/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:11.414051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:11.533168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe66f6-eecf-4923-a1f5-4444bbb8ec2f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:11.591809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:11.592815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:11.593315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:11.593778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:11.595019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:11.595617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:11.598519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e09837-543b-4bbb-b9b7-3768fcd544b3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:11.624161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 634/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:11.631325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:11.660507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:11.741364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411da95-e48c-4bdc-a4e6-4af5d6c05314 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:11.778885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:11.779529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:11.779815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:11.780200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:11.780935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=f1b1de8ca7b349ad98880b604d1cb6cb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:11.781248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:11.782698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5ea3-2fbb-4bcb-91c0-e54fa7d282b0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:11.788789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 626/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:29:11 2022] GET /identity/v3/role_assignments?user.id=f1b1de8ca7b349ad98880b604d1cb6cb&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:13.793864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e166b-bfba-41d5-bca8-d0e933a4d0fe None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:13.794504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e166b-bfba-41d5-bca8-d0e933a4d0fe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:13.794504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e166b-bfba-41d5-bca8-d0e933a4d0fe None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:13.795800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 635/1261] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:29:13.801713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:13.802198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:13.802313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:13.826182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:13.827522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:13.913475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 627/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:29:14.189645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e166b-bfba-41d5-bca8-d0e933a4d0fe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:14.202265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:14.334751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e166b-bfba-41d5-bca8-d0e933a4d0fe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:14.403170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:14.404273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:14.404770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:14.405261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:14.425488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:29:14.435389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:14.436612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:14.437698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 636/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:14.444665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:14.467874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:14.571871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd445d-cb8e-4c2b-a4e4-23df77e0ade1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:14.615004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:14.615800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:14.616176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:14.616519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:14.617252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:14.617604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:14.619124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:14.630241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 628/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:14.636619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:14.716429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:14.755944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31664-a0fa-4388-9151-92d880d58e5a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:14.818230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:14.819342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:14.819830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:14.820285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:14.839477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:14.842191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:14.871004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:14.872086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:14.873006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:14.873006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:14.873006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:14.873184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 637/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:14.882983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:15.032392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:15.054075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f13722-755f-4248-89b2-1fae79ccc958 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:15.092371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:15.092987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:15.093300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:15.093578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:15.094259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:15.094567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:15.096134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:15.112676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 629/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:15.121232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:15.278890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539d1e-1389-408f-a9b5-b1aedb81df4d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:15.301618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:15.319217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:15.319888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:15.320165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:15.320443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:15.329915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:15.331384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:29:15.344568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:15.346319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:15.347889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 638/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:15.353902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:15.518332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594d544-d52c-42ef-a1ec-d58e5da09c00 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:15.587558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:15.588316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:15.588813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:15.589318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:15.590748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:15.591345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:15.594161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:15.607600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:15.617322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 630/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:15.624728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:15.768235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863de6-9fef-4178-8436-350b5ac2c5e0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:15.819136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:15.819945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:15.820075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:15.820305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:15.833181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:15.834648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:15.857769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:15.859747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:15.861538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:15.861538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:15.861538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:15.861538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 639/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:15.867104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:15.987144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d69c2-5ad1-4066-b5e5-77573c168d06 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:16.031573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:16.032623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:16.033124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:16.033619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:16.034792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:16.035366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:16.038113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:16.061181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 631/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:16.067884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:16.105253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:16.188393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d417-874f-483a-8f91-1e6d43ff4366 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:16.229237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:16.229942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:16.230262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:16.230588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:16.238545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:16.240214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:29:16.256082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:16.257768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:16.260327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 640/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:16.264790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:16.332561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:16.381578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71310d5b-5584-414f-a4bc-862955d77642 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:16.420647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:16.421259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:16.421534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:16.421807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:16.422537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:16.422840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:16.424322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848117df-6fe0-443f-aeb9-ded9f59458e4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:16.440860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 632/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:16.445533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:16.560935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:16.572123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-cff2-43ed-9b22-84be9e233895 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:16.612127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:16.619146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:16.619146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:16.619146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] PATH_INFO: `/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/f1b1de8ca7b349ad98880b604d1cb6cb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:16.619146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=51a3e6d90af942ef87e7d015c8f32837, user_id=f1b1de8ca7b349ad98880b604d1cb6cb, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:16.619146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ab6e0-29a8-4d4a-9b6d-144e7c9edcd5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:16.726079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 641/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 17:29:16 2022] PUT /identity/v3/projects/51a3e6d90af942ef87e7d015c8f32837/users/f1b1de8ca7b349ad98880b604d1cb6cb/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:29:18.747102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f237d04-9c38-43ef-a2cf-5d5ddaea3f1a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:18.747719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f237d04-9c38-43ef-a2cf-5d5ddaea3f1a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:18.747719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f237d04-9c38-43ef-a2cf-5d5ddaea3f1a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:18.749033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 633/1274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:29:18.755303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:18.755840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:18.755840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:18.776218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:18.777453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:18.858378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 642/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:29:19.154942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f237d04-9c38-43ef-a2cf-5d5ddaea3f1a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:19.314710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f237d04-9c38-43ef-a2cf-5d5ddaea3f1a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:19.350123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:19.371043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:19.371774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:19.372112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:19.372441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:19.384431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:29:19.389631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:19.391522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:19.393522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 634/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 17:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:19.399248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:19.501455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:19.526668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245c28-56c5-4f86-957b-2b3e43805b07 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:19.567735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:19.568470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:19.568808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:19.569192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:19.570121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:19.570490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:19.572515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:19.582130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 643/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 17:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:19.588909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:19.718669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23c40f-8e9c-42f4-b41e-093d8efd5de1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:19.763994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:19.765173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:19.765439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:19.765798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:19.781215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:19.783365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:19.805214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:19.806837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:19.808019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:19.808019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:19.808019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:19.808019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 635/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:19.814526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:19.952961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a9a9d-63ed-4183-a433-2ace7dc56575 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:19.998274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:19.998995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:19.999384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:19.999722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:20.000456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:20.000829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:20.002487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:20.024886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 644/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:20.028464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:20.067711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.167065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010359-c363-448d-8af8-7b7ccc41b9d2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:20.215865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:20.216522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:20.216789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:20.217064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:20.226738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:20.228921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:29:20.242284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:20.245715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:20.247806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 636/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:20.253764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:20.259986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.377022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af115-d697-4c18-9ba0-bd636b89df4d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:20.414767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:20.416157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:20.416627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:20.416902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:20.417648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:20.417954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:20.419435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:20.440054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 645/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 17:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:20.449045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:20.556938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.568880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849651-7f55-42e5-9167-b03565776de5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:20.610433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:20.611099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:20.611401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:20.611675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:20.698073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:20.699657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:20.808765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.826224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 637/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 17:29:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 17:29:20.832432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:20.936675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.983824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef680da-2572-430d-bcb6-6de4328672e0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:21.047766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:21.048516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:21.048882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:21.049201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:21.061211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:21.062701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:29:21.080274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:21.082063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:29:21.083523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:29:21.083523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:29:21.083523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:21.083523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 646/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:29:21.089111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:21.246765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde3967-02b0-4788-ba06-52e0a3975cd7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:21.307486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:21.308498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:21.308974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:21.309473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:21.310643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:21.311181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:21.313721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:21.333932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 638/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:21.340292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:21.448153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede9c-c3bc-4c6a-9d7c-d6121eeaff8a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:21.463732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:21.488187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:21.488827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:21.489107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:21.489388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:21.503600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:21.503600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:29:21.512457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:21.514071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Aug 24 17:29:21.515034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 647/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 17:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:21.522949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:21.588472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:21.651478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd1e-4313-4963-92f4-93415a2ad98d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:21.690241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:21.691132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:21.691411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:21.691677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:21.692361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:21.692699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:21.694179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8f5c-7973-4f2d-b965-25b965a36cdb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:21.708339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 639/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 17:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:21.715512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:21.833718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1bf2-8dbd-43ea-bb63-0103f4e52755 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:21.876834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:21.877758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:21.878117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:21.878401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:21.880097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] RBAC: Adding query filter params (role.id=16cadafb0e8f49c08c22f1a7c8c1ded6, scope.project.id=51a3e6d90af942ef87e7d015c8f32837, user.id=f1b1de8ca7b349ad98880b604d1cb6cb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:21.880911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:21.883028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff66c2-3f8e-4393-b2cd-eab4af03a2d5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:21.890607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 648/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 17:29:21 2022] GET /identity/v3/role_assignments?user.id=f1b1de8ca7b349ad98880b604d1cb6cb&scope.project.id=51a3e6d90af942ef87e7d015c8f32837&role.id=16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:23.894830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f690f-b469-4a58-9754-e17afc0f8a68 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:23.895442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f690f-b469-4a58-9754-e17afc0f8a68 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:23.895730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f690f-b469-4a58-9754-e17afc0f8a68 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:23.898262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 640/1288] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:29:23.905469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:23.906175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:23.906175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:23.939521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:23.941847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:24.004511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:24.052055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 649/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:29:24.324769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f690f-b469-4a58-9754-e17afc0f8a68 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:24.451741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f690f-b469-4a58-9754-e17afc0f8a68 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:24.466965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:24.494937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:24.495809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:24.496204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:24.496581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:24.497273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:24.498847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:24.509037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:24.512189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:24.513839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 641/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:29:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:24.519595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:24.634696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34226-c890-4bea-a812-a2da04785c41 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:24.670231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:24.670836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:24.671135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:24.671408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:24.672031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:24.672372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:24.673693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138e9e-eb4a-42e5-97fa-13a83c1420fc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:24.678866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 650/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 17:29:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:24.685859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:24.790340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784f53-e76b-4e6c-9ba8-0841803c652c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:24.825021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:24.825624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:24.825897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:24.826168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:24.826872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:24.827197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:24.828578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a045-6485-422f-b05f-27a46dd0b3f0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:24.833124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 642/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 17:29:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:26.801015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4b69f-dc6d-400e-9a03-5e2b3bc1e008 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:26.801588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4b69f-dc6d-400e-9a03-5e2b3bc1e008 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:26.801588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4b69f-dc6d-400e-9a03-5e2b3bc1e008 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:26.802913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 651/1293] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:29:26.810079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab180af5-f173-48a9-b616-62caf9c37625 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:26.810850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab180af5-f173-48a9-b616-62caf9c37625 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:26.810850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab180af5-f173-48a9-b616-62caf9c37625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:26.830464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab180af5-f173-48a9-b616-62caf9c37625 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:26.831709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab180af5-f173-48a9-b616-62caf9c37625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:26.864816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:26.906386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 643/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:29:27.182796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4b69f-dc6d-400e-9a03-5e2b3bc1e008 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:27.217274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:27.296734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4b69f-dc6d-400e-9a03-5e2b3bc1e008 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:27.334576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:27.335250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:27.335565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:27.335844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:27.337052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:27.338448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19680-1b6f-4025-b714-1c2fedb7f750 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:27.429333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 652/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 17:29:27 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:29:29.482746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51285-290d-4959-8a16-7cc1149a4139 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:29.483446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51285-290d-4959-8a16-7cc1149a4139 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:29.483446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51285-290d-4959-8a16-7cc1149a4139 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:29.484823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 644/1296] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:29:29.491794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:29.492336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:29.493533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:29.527104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:29.529428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:29.636866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 653/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:29:29.920222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b51285-290d-4959-8a16-7cc1149a4139 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:30.043452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b51285-290d-4959-8a16-7cc1149a4139 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:30.082773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:30.083584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:30.086154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:30.086154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:30.086154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:30.086154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:30.101756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:30.103820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:30.104750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 645/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:29:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:30.110405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:30.131396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:30.223887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee98eab-b925-4175-ba53-31802fd27185 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:30.267957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:30.268645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:30.269109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:30.269465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:30.270442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:30.270990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:30.273691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:30.284261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 654/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 17:29:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:30.291513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:30.326656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:30.404940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d998fb-1198-47f4-b8a0-bbbd2f5e3b98 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:30.444795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:30.445403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:30.445684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:30.445966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:30.446676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] RBAC: Adding query filter params (interface=public, service_id=124269276674499f85de849a62b31ad2, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:30.446996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:30.448513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faf1c5-4bd9-49fa-8b7d-272ff292a848 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:30.454445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 646/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 17:29:30 2022] GET /identity/v3/endpoints?service_id=124269276674499f85de849a62b31ad2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:29:30.460708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:30.555283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:30.579165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0cc50-4828-4832-b7ab-0f14d2c0603e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:30.616163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:30.621956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:30.621956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:30.621956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:30.621956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:30.621956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56509909-dd7d-494e-9ad4-f8ae65130b49 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:30.633070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 655/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 17:29:30 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:29:32.790669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8be08-8ac4-480e-9a1b-de5f3e820373 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:32.791329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8be08-8ac4-480e-9a1b-de5f3e820373 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:32.791499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8be08-8ac4-480e-9a1b-de5f3e820373 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:32.792986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 647/1302] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:29:32.799029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:32.800000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:32.800000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:32.819362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:29:32.820635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:32.902665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 656/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:29:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:29:33.187197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8be08-8ac4-480e-9a1b-de5f3e820373 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:33.298181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:33.305834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8be08-8ac4-480e-9a1b-de5f3e820373 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:33.343625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:33.344265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:33.344544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:33.344813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:33.345395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:33.346771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:29:33.356629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:29:33.359045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Aug 24 17:29:33.360821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 648/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 17:29:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:29:33.366172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:33.454645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:33.482001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c2bf-bc7f-4f7b-baf4-1cbf775da6fd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:33.520143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:33.520752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:33.521035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:33.521305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:33.521940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:29:33.522241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:33.523737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc8592-4d58-4222-b29d-ed34697533bc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:33.530707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 657/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 17:29:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:29:33.540587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:33.662993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ff7a1-73a6-46d2-90c6-805d30aface0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:33.703583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:33.704199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:33.704475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:33.704813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:33.705411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:33.706922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea525c-73c4-44bb-a0f7-ac8b6ce6ebd7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:33.863149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 649/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:29:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:29:43.589828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=30 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:43.853891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:18.349055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3205a-6771-4e15-8e96-d7c8e379f22e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:18.349920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3205a-6771-4e15-8e96-d7c8e379f22e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:18.350360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3205a-6771-4e15-8e96-d7c8e379f22e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:18.355497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 658/1307] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:18.358407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a837-f509-487b-a776-cdd1133b9c8a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:18.359327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a837-f509-487b-a776-cdd1133b9c8a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:18.359761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698a837-f509-487b-a776-cdd1133b9c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:18.449421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7698a837-f509-487b-a776-cdd1133b9c8a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:18.450904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7698a837-f509-487b-a776-cdd1133b9c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:18.663166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 650/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:18.978050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:18.978983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:18.980039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:18.983682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 659/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 17:36:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:18.990638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfcd99-6e1c-45c9-b53c-2018693591d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:18.990638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfcd99-6e1c-45c9-b53c-2018693591d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:18.990944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfcd99-6e1c-45c9-b53c-2018693591d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:19.151003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-75dfcd99-6e1c-45c9-b53c-2018693591d0 None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:19.154006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-75dfcd99-6e1c-45c9-b53c-2018693591d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:19.177743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:19.267439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 651/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:19.267993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:19.269729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:19.437028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803788-e5c3-4768-8c8e-e94f64bcece8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:19.533912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:19.534602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:19.534892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:19.535205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:19.536849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:19.608408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:19.673071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:19.674680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04cad3-3088-40fe-bc01-f606ec3cc1b4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:19.697983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 660/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:36:21.945389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a78d-9cfa-484b-95a7-58eca6c45085 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:21.945904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a78d-9cfa-484b-95a7-58eca6c45085 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:21.945904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a78d-9cfa-484b-95a7-58eca6c45085 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:21.947429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 652/1312] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:21.952608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2cc5-556d-48fe-b470-8479ee909a8c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:21.953039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2cc5-556d-48fe-b470-8479ee909a8c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:21.953153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2cc5-556d-48fe-b470-8479ee909a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:22.038712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b53d2cc5-556d-48fe-b470-8479ee909a8c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:22.040616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b53d2cc5-556d-48fe-b470-8479ee909a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:22.141889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 661/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:22.449465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:22.449846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:22.450200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:22.451700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 653/1314] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 17:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:22.457729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016c8f-a7e9-4dfd-b53d-99bd8576de3f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:22.458026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016c8f-a7e9-4dfd-b53d-99bd8576de3f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:22.458307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016c8f-a7e9-4dfd-b53d-99bd8576de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:22.470905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:22.543157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f8016c8f-a7e9-4dfd-b53d-99bd8576de3f None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:22.544337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f8016c8f-a7e9-4dfd-b53d-99bd8576de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:22.621135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 662/1315] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 17:36:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:22.630421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:22.632006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:22.738311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58708-f116-4ba0-b0a1-06f85002cc85 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:22.809743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:22.812187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:22.812789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:22.813065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:22.813336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:22.814940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:22.925263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:22.926713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01a64-3677-4593-8e64-621e18906b81 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:22.944856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 654/1316] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:36:25.620880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:25.621501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:25.621501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:25.622783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 663/1317] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:25.628311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38f0c-21ff-4600-819d-02a94df0856b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:25.628756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38f0c-21ff-4600-819d-02a94df0856b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:25.628875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38f0c-21ff-4600-819d-02a94df0856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:25.696756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-95b38f0c-21ff-4600-819d-02a94df0856b None None] MFA Rules not processed for user `882f064a2b264510bf73482a34370172`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:25.698130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95b38f0c-21ff-4600-819d-02a94df0856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:25.749262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:25.793843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 655/1318] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:26.077937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:26.079517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:26.184200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4529-24a7-402c-a89c-ba677b38aee9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:26.187138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:26.259533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:26.260156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:26.260436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:26.260709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:26.262309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:26.371373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:26.372793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14005191-ffcc-4006-8828-bb65ba1d1462 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:26.391207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 664/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:29.105226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:29.105878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:29.105878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:29.107220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 656/1320] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:29.112389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929938-6dd6-4f72-b96e-f1c9a0a9fe57 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:29.112849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929938-6dd6-4f72-b96e-f1c9a0a9fe57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:29.112958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929938-6dd6-4f72-b96e-f1c9a0a9fe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:29.155313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:29.180421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a9929938-6dd6-4f72-b96e-f1c9a0a9fe57 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:29.181611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9929938-6dd6-4f72-b96e-f1c9a0a9fe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:29.278779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 665/1321] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:36:29.568063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:29.569688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:29.676215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666656c0-3b59-4c08-90f3-d7bc33918127 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:29.752727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:29.753329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:29.753605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:29.753875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:29.755491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:29.763151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:29.866486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:29.868178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25f9b3-4dde-441e-991c-f0d1002e95d5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:29.886864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 657/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:32.964438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040164fd-8a61-4cba-a35f-86062822097f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:32.965008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040164fd-8a61-4cba-a35f-86062822097f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:32.965008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040164fd-8a61-4cba-a35f-86062822097f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:32.966540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 666/1323] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:32.971984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08165d0-eed8-4abf-8928-fb7e74d9b15a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:32.972432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08165d0-eed8-4abf-8928-fb7e74d9b15a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:32.972552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08165d0-eed8-4abf-8928-fb7e74d9b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:33.042688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e08165d0-eed8-4abf-8928-fb7e74d9b15a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:33.043957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e08165d0-eed8-4abf-8928-fb7e74d9b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:33.103676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:33.144010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 658/1324] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:33.522362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040164fd-8a61-4cba-a35f-86062822097f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:33.522362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-040164fd-8a61-4cba-a35f-86062822097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:33.538161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040164fd-8a61-4cba-a35f-86062822097f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:33.552418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:33.622813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:33.623555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:33.623836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:33.624139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:33.625808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:33.747655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:33.749123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280f6a2-c64b-4727-9434-ad4a3d5f5255 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:33.767923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 667/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:35.763006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:35.763635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:35.763635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:35.765040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 659/1326] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:35.770976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470df4-e575-4918-8e08-7f652b3cd19a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:35.771563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470df4-e575-4918-8e08-7f652b3cd19a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:35.771563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470df4-e575-4918-8e08-7f652b3cd19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:35.825357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:35.844846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cc470df4-e575-4918-8e08-7f652b3cd19a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:35.846095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc470df4-e575-4918-8e08-7f652b3cd19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:35.952169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 668/1327] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:36.236808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:36.238336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:36.345133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1877d1-d45d-4878-9077-ea8ae680adfa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:36.420498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:36.421106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:36.421384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:36.421659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:36.423346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:36.441860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:36.542627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:36.544139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0537e0-0bb0-4f63-a10c-0aa3b9f50ac7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:36.563489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 660/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:38.551766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:38.552274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:38.552377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:38.553709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 669/1329] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:38.559706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcfed4-7a64-4913-a50c-e2d03b7648e1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:38.560153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcfed4-7a64-4913-a50c-e2d03b7648e1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:38.560275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcfed4-7a64-4913-a50c-e2d03b7648e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:38.633827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b5fcfed4-7a64-4913-a50c-e2d03b7648e1 None None] MFA Rules not processed for user `882f064a2b264510bf73482a34370172`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:38.635182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5fcfed4-7a64-4913-a50c-e2d03b7648e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:38.705893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:38.738945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 661/1330] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:39.026709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:39.028333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:39.133289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edb93-262e-4dfa-8299-287c09bd89f2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:39.156611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:39.213064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:39.213673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:39.213958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:39.214227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:39.215914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:39.347957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:39.349399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36afde6-e768-4c22-b4a2-2a4a6abc5ebd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:39.371659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 670/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:41.740007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:41.740563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:41.740563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:41.741948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 662/1332] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:41.748474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07f5a-412d-445d-8a62-5423e0668682 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:41.748871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07f5a-412d-445d-8a62-5423e0668682 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:41.749033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07f5a-412d-445d-8a62-5423e0668682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:41.813569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:41.816289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dcd07f5a-412d-445d-8a62-5423e0668682 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:41.817645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcd07f5a-412d-445d-8a62-5423e0668682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:41.916876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 671/1333] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:42.202752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:42.204358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:42.310387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06ed6-b83a-492c-a73a-0379724ff541 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:42.386106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:42.386707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:42.386984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:42.387281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:42.388856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:42.416817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:42.500177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:42.501557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b948-79c5-4a31-9ae5-45c66e179e13 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:42.520084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 663/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:44.511513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:44.512051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:44.512051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:44.513432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 672/1335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:44.518649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aff59-4f2a-4252-a4f9-933345418182 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:44.519101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aff59-4f2a-4252-a4f9-933345418182 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:44.519232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aff59-4f2a-4252-a4f9-933345418182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:44.588709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-669aff59-4f2a-4252-a4f9-933345418182 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:44.589836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-669aff59-4f2a-4252-a4f9-933345418182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:44.663847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:44.686040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 664/1336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:44.977650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:44.979215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:45.085424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8a59-28f8-4e1e-b2fe-afe774775ec9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:45.113782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:45.158545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:45.159173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:45.159454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:45.159724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:45.161307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:45.270456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:45.271935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115462-f964-4d2e-a403-3197e4aee0ca service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:45.290519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 673/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:47.788038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:47.788600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:47.788600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:47.790130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 665/1338] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:47.795336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70115-ab0a-4b86-9637-df02965f46e8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:47.795721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70115-ab0a-4b86-9637-df02965f46e8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:47.795947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70115-ab0a-4b86-9637-df02965f46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:47.868899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8ee70115-ab0a-4b86-9637-df02965f46e8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:47.870024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ee70115-ab0a-4b86-9637-df02965f46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:47.878575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:47.969364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 674/1339] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:48.252984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:48.254509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:48.359612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3d074-566b-4a17-8fe0-62f833188253 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:48.433321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:48.433921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:48.434205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:48.434478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:48.436097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:48.472371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:48.547052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:48.548409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039a45e-e423-4cb0-b6c2-5c43d2f2bd1b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:48.567072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 666/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:53.153730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:53.154292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:53.154413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:53.155793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 675/1341] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:53.161500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af7ae-8f17-4a71-9fc3-c78a9bf164a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:53.161942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af7ae-8f17-4a71-9fc3-c78a9bf164a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:53.162122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af7ae-8f17-4a71-9fc3-c78a9bf164a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:53.231728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-345af7ae-8f17-4a71-9fc3-c78a9bf164a8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:53.232951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-345af7ae-8f17-4a71-9fc3-c78a9bf164a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:53.323799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:53.335450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 667/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:53.620437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:53.621984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:53.725921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b8bd-2bb2-40f3-8b65-b8c615509b44 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:53.768399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:53.804363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:53.805543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:53.805823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:53.806123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:53.808737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:53.921146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:53.922495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88221a50-322e-49c9-9040-26e0ac1a99e9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:53.941864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 676/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:36:56.881535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:56.882057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:56.882057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:56.884023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 668/1344] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:36:56.889050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd674-26b3-44ae-a6cc-52d53b0a2735 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:56.889454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd674-26b3-44ae-a6cc-52d53b0a2735 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:56.889606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd674-26b3-44ae-a6cc-52d53b0a2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:56.961320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8cccd674-26b3-44ae-a6cc-52d53b0a2735 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:36:56.962544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cccd674-26b3-44ae-a6cc-52d53b0a2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:56.982160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:57.063605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 677/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:36:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:36:57.350914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:36:57.352684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:57.461727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b358-d8ed-4312-b3b2-16a9bf18f04b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:36:57.537495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:36:57.538016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:36:57.538304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:36:57.538581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:36:57.540281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:36:57.589366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:57.661392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:36:57.662881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778fb2-e08d-4b92-89cb-4e3e5e423dbc service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:36:57.685471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 669/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:36:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:01.931571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:01.932130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:01.932546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:01.933962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 678/1347] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:01.939846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5cc1c-b2e8-492c-b9d4-758513c5742d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:01.940352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5cc1c-b2e8-492c-b9d4-758513c5742d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:01.940466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5cc1c-b2e8-492c-b9d4-758513c5742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:02.016533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2ee5cc1c-b2e8-492c-b9d4-758513c5742d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:02.017765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ee5cc1c-b2e8-492c-b9d4-758513c5742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:02.122603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:02.127811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 670/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:02.413044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:02.414605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:02.526365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa75ff-e90b-4370-b428-408896357e10 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:02.579793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:02.612064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:02.612722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:02.613005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:02.613280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:02.614922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:02.731885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:02.733348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083d3c-7616-47b0-88fa-caf405b981b5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:02.751536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 679/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:07.740072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f144a-11b6-4bfe-b9f8-4a4a0c10cf92 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:07.740625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f144a-11b6-4bfe-b9f8-4a4a0c10cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:07.740625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f144a-11b6-4bfe-b9f8-4a4a0c10cf92 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:07.742231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 671/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:07.751617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fe1f-952a-4065-b535-00df15138790 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:07.752092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fe1f-952a-4065-b535-00df15138790 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:07.752092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fe1f-952a-4065-b535-00df15138790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:07.890577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd89fe1f-952a-4065-b535-00df15138790 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:07.891932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd89fe1f-952a-4065-b535-00df15138790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:07.913839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:08.024009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 680/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:37:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:12.105024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1dd9e-bbfb-4dc9-a66d-28281c3d90c3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:12.105567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1dd9e-bbfb-4dc9-a66d-28281c3d90c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:12.105567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1dd9e-bbfb-4dc9-a66d-28281c3d90c3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:12.107257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 672/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:12.112522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9063-8d94-4dd5-aafc-84621b7ce83a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:12.113007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9063-8d94-4dd5-aafc-84621b7ce83a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:12.113190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9063-8d94-4dd5-aafc-84621b7ce83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:12.197176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4e2d9063-8d94-4dd5-aafc-84621b7ce83a None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:12.198389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4e2d9063-8d94-4dd5-aafc-84621b7ce83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:12.274207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:12.315748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 681/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:37:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:13.900540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d797bb-7eaa-43f3-9ed9-d92dda53abef None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:13.901053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d797bb-7eaa-43f3-9ed9-d92dda53abef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:13.901053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d797bb-7eaa-43f3-9ed9-d92dda53abef None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:13.902417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 673/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:13.908074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88febc-7988-4cce-9975-b0dc0690fdf8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:13.908502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88febc-7988-4cce-9975-b0dc0690fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:13.908655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88febc-7988-4cce-9975-b0dc0690fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:13.991944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af88febc-7988-4cce-9975-b0dc0690fdf8 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:13.993843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af88febc-7988-4cce-9975-b0dc0690fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:14.104943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 682/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:37:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:17.395052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d852-3d6b-4122-8175-b80b6cebe4fe None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:17.395620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d852-3d6b-4122-8175-b80b6cebe4fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:17.395723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d852-3d6b-4122-8175-b80b6cebe4fe None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:17.397230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 674/1356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:17.402465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7406c-f1c1-4395-ad98-2880e3470687 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:17.403270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7406c-f1c1-4395-ad98-2880e3470687 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:17.403732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7406c-f1c1-4395-ad98-2880e3470687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:17.449331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:17.488996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37b7406c-f1c1-4395-ad98-2880e3470687 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:17.493392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37b7406c-f1c1-4395-ad98-2880e3470687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:17.634912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 683/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:17.953444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:17.954761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:17.955331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:17.959814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 675/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 17:37:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:17.966508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6e82-7f10-4e93-a93e-55b6341f9bbe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:17.967431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6e82-7f10-4e93-a93e-55b6341f9bbe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:17.968306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6e82-7f10-4e93-a93e-55b6341f9bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:18.065299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-21bd6e82-7f10-4e93-a93e-55b6341f9bbe None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:18.066652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21bd6e82-7f10-4e93-a93e-55b6341f9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:18.123153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:18.195806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 684/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 17:37:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:18.203300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:18.205057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:18.367602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cfee0-d4dc-4641-b62c-655f21feb327 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:18.447877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:18.489959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:18.490573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:18.490852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:18.491140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:18.493696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:18.587097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:18.588728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75d5c9-8d3a-4e72-81bb-08496f6598b8 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:18.608994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 676/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:20.805385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:20.805923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:20.805923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:20.807768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 685/1361] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:20.812945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cbf29-b59b-4356-a2a4-328c4e7f9898 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:20.813730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cbf29-b59b-4356-a2a4-328c4e7f9898 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:20.814014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cbf29-b59b-4356-a2a4-328c4e7f9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:20.886153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f05cbf29-b59b-4356-a2a4-328c4e7f9898 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:20.887382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f05cbf29-b59b-4356-a2a4-328c4e7f9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:20.944431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:21.030989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 677/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:21.326846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:21.328459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:21.487757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032ba0d-0d6f-4e50-ba0e-d62b47a2436b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:21.498143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:21.615140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:21.615877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:21.616224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:21.616559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:21.618402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:21.728430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:21.730163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443c48-9843-42c7-ae32-ba82b04d5609 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:21.750863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 686/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:24.209812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334223ee-70c7-4321-8ab0-3aa77931d8bc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:24.210390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334223ee-70c7-4321-8ab0-3aa77931d8bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:24.210390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334223ee-70c7-4321-8ab0-3aa77931d8bc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:24.212633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 678/1364] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:24.218338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84605d-dcd3-4708-8752-eaf32d3670d8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:24.218751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84605d-dcd3-4708-8752-eaf32d3670d8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:24.218921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84605d-dcd3-4708-8752-eaf32d3670d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:24.235963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:24.289297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4f84605d-dcd3-4708-8752-eaf32d3670d8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:24.291757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f84605d-dcd3-4708-8752-eaf32d3670d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:24.400890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 687/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:24.698325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:24.698912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:24.699350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:24.701626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 679/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 17:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:24.707066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c935f6-53c5-4940-956b-6d3fc6b5262a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:24.707380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c935f6-53c5-4940-956b-6d3fc6b5262a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:24.707656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c935f6-53c5-4940-956b-6d3fc6b5262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:24.814535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-89c935f6-53c5-4940-956b-6d3fc6b5262a None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:24.816651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-89c935f6-53c5-4940-956b-6d3fc6b5262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:24.883442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:25.042081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 688/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:25.050853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:25.052511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:25.228558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52cb4b-10dc-4176-9348-b7d1cbef6bb5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:25.251758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:25.350809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:25.351500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:25.351783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:25.352051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:25.353631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:25.448184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:25.449798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd40f5-b596-41b3-8b35-7506eb2cdef3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:25.468879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 680/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:25.838293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df129-a08a-4370-9b37-b3a582743957 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:25.838834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df129-a08a-4370-9b37-b3a582743957 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:25.838834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df129-a08a-4370-9b37-b3a582743957 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:25.840460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 689/1369] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:37:25.846625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a20a-d5e4-46ec-97cc-f4ea969356b3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:25.847100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a20a-d5e4-46ec-97cc-f4ea969356b3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:25.847602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a20a-d5e4-46ec-97cc-f4ea969356b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:25.886813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:25.927381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7740a20a-d5e4-46ec-97cc-f4ea969356b3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:25.928638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7740a20a-d5e4-46ec-97cc-f4ea969356b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:26.039632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 681/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:26.632796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:26.632796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:26.632796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:26.633956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 690/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 17:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:26.638094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ab67-f084-46cb-bf58-ccfa3129b08f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:26.638533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ab67-f084-46cb-bf58-ccfa3129b08f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:26.638691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ab67-f084-46cb-bf58-ccfa3129b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:26.724054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1110ab67-f084-46cb-bf58-ccfa3129b08f None None] MFA Rules not processed for user `070d1f13e4954e999ae30434d4df6d42`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:26.725302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1110ab67-f084-46cb-bf58-ccfa3129b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:26.779414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:26.812947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 682/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 17:37:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:26.820454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:26.821979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:26.941144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb5fde-e744-4dcc-8a42-fd68a0f1a578 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:26.983804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:27.018930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:27.019597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:27.019871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:27.020211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:27.021737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:27.149380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:27.150821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217726e-a516-4de9-83a9-5193ebfe4a91 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:27.173201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 691/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:27.714815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:27.715388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:27.715523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:27.716801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 683/1374] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:27.722187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688191b4-c546-4a61-9ba7-6109554d6c46 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:27.722516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688191b4-c546-4a61-9ba7-6109554d6c46 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:27.722801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688191b4-c546-4a61-9ba7-6109554d6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:27.792475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-688191b4-c546-4a61-9ba7-6109554d6c46 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:27.793708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-688191b4-c546-4a61-9ba7-6109554d6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:27.818965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:27.905237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 692/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:28.198851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:28.200417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:28.346055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219666e-c441-45a0-880a-e86cee96ec78 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:28.397439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:28.462009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:28.462468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:28.462749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:28.463025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:28.464650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:28.558220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:28.559942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dc2ad-8f03-4497-acf4-f8ffa057157b service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:28.583673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 684/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:30.741810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:30.742310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:30.742691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:30.744298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 693/1377] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:30.749953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6617f4-7439-4980-ba0a-f0fab4138d4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:30.750400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6617f4-7439-4980-ba0a-f0fab4138d4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:30.750495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6617f4-7439-4980-ba0a-f0fab4138d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:30.845334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4a6617f4-7439-4980-ba0a-f0fab4138d4f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:30.846475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a6617f4-7439-4980-ba0a-f0fab4138d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:30.854786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:30.973162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 685/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:31.270030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:31.271900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:31.461615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35c07d-19fa-4da0-b990-fe00c6a54aa3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:31.466695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:31.619798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:31.620834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:31.621339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:31.621994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:31.624017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:31.735700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:31.737314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f577ce7-a0a9-47d9-ba9d-8dc19939e10a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:31.759266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 694/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:33.945748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:33.946439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:33.946439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:33.947833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 686/1380] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:33.953161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6740d6-a560-43ef-9fe6-748a7365f46f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:33.953573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6740d6-a560-43ef-9fe6-748a7365f46f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:33.953801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6740d6-a560-43ef-9fe6-748a7365f46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:33.965467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:34.026059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4d6740d6-a560-43ef-9fe6-748a7365f46f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:34.029080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d6740d6-a560-43ef-9fe6-748a7365f46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:34.139134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 695/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:34.426042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:34.427580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:34.578178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:34.595391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a1113-ba72-4eaa-a029-2c0165c7c211 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:34.719326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:34.719936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:34.720218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:34.720491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:34.722289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:34.815249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:34.816837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa286c-06bf-43e6-8789-0d9d0211e4aa service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:34.828589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:34.837953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 687/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:37.203012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:37.203629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:37.203831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:37.205663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 696/1383] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:37.211299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0edde-767a-41e0-b93b-e20d29cbe49e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:37.211800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0edde-767a-41e0-b93b-e20d29cbe49e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:37.211969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0edde-767a-41e0-b93b-e20d29cbe49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:37.285192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-53c0edde-767a-41e0-b93b-e20d29cbe49e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:37.286453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53c0edde-767a-41e0-b93b-e20d29cbe49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:37.407434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 688/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:37.702345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:37.703893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:37.794230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:37.858249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f2b8-1377-40d7-9b20-a642313fc411 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:37.996803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:37.997642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:37.997998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:37.998358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:38.000733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:38.068917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:38.120377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:38.122357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6e10-a799-4589-bc0a-9aa1042699a3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:38.144091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 697/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:40.277116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:40.277831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:40.277831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:40.279106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 689/1386] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:40.284807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1e20-842f-4bac-9cca-5e1983d94d36 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:40.285766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1e20-842f-4bac-9cca-5e1983d94d36 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:40.285766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1e20-842f-4bac-9cca-5e1983d94d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:40.356472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-95bd1e20-842f-4bac-9cca-5e1983d94d36 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:40.357712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95bd1e20-842f-4bac-9cca-5e1983d94d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:40.460677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 698/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:40.749424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:40.751329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:40.835156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:40.917880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25a12-00a4-4e7c-b96b-96753c709f0d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:41.040424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:41.041279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:41.041279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:41.041557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:41.043173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:41.084106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:41.140690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:41.142289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab25e-e1f3-4150-9d41-e48c2ad20c57 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:41.160865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 690/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:42.883321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51e20-5c47-4292-bcae-36e74ba983ae None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:42.883856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51e20-5c47-4292-bcae-36e74ba983ae None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:42.883856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51e20-5c47-4292-bcae-36e74ba983ae None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:42.885178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 699/1389] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:37:42.890726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab694b5-ca4e-4481-a24d-912fcef2f8d2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:42.891182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab694b5-ca4e-4481-a24d-912fcef2f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:42.891436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab694b5-ca4e-4481-a24d-912fcef2f8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:42.962915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bab694b5-ca4e-4481-a24d-912fcef2f8d2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:42.964389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bab694b5-ca4e-4481-a24d-912fcef2f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.065883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 691/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:37:43.247583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7573-bfbf-469b-89e7-0ba1fc99b2d6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.247808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7573-bfbf-469b-89e7-0ba1fc99b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.248180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7573-bfbf-469b-89e7-0ba1fc99b2d6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.249526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 700/1391] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:43.255057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.255385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.255659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.271737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:43.327467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:43.328689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.365868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abfe5-c787-4421-8ff8-125c053e7ef9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.366363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abfe5-c787-4421-8ff8-125c053e7ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.366720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abfe5-c787-4421-8ff8-125c053e7ef9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.368210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 701/1392] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 17:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:37:43.373005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.373349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.373641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.406538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:43.430936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 692/1393] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:37:43.454645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] MFA Rules not processed for user `e4e90e02cb2741c6bda1ecd01d92cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:43.455890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.533676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 702/1394] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:37:43.541623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:43.542970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.640984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe9b6d-0412-4738-8318-0090f7e1005f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:43.650600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:43.719839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:43.720655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.720939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.721210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.722792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.726595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:43.728635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:43.839538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:43.841433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d245a8-6764-4950-abab-b19cc3a399f3 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:43.854038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a5ed-d047-4928-9e00-83ca404544bc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:43.857814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:43.862327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 693/1395] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:43.976706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:43.977810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:43.978120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:43.978395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:43.980068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:44.073953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:44.075635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892e6a6-af0b-492a-a482-a909516a8acf service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:44.097414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 703/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:37:44.777813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275a38-135b-441d-92d0-da89ea9f4b85 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:44.778384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275a38-135b-441d-92d0-da89ea9f4b85 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:44.778384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275a38-135b-441d-92d0-da89ea9f4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:44.950587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:44.974174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-73275a38-135b-441d-92d0-da89ea9f4b85 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:44.975482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73275a38-135b-441d-92d0-da89ea9f4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:45.079428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 694/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:45.129316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:45.129841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:45.129966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:45.131782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 704/1398] 10.222.0.65 () {54 vars in 943 bytes} [Wed Aug 24 17:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:45.138234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db47c7-d0ca-4e82-a5ca-a23bfc2f4f04 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:45.138518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db47c7-d0ca-4e82-a5ca-a23bfc2f4f04 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:45.138806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db47c7-d0ca-4e82-a5ca-a23bfc2f4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:45.225392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d9db47c7-d0ca-4e82-a5ca-a23bfc2f4f04 None None] MFA Rules not processed for user `dd90ca5a48c7411eaee2f3fda54d9dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:45.226611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9db47c7-d0ca-4e82-a5ca-a23bfc2f4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:45.298564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:45.352576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 695/1399] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Aug 24 17:37:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:45.362261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:45.363882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:45.374678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:45.520378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683819c-7c28-4d13-bc71-9fee9c783b22 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:45.648819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:45.657808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:45.658436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:45.658715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:45.658986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:45.660698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:45.772018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:45.773774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72255d4-b93e-4a8a-9289-04879053ce0f service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:45.782370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 705/1400] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:37:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:37:46.260762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:46.261314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:46.263343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:46.265098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 696/1401] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:37:46.270635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a083e5-16a1-464a-87f3-a75b862e43bf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:46.271146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a083e5-16a1-464a-87f3-a75b862e43bf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:46.271265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a083e5-16a1-464a-87f3-a75b862e43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:46.345335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34a083e5-16a1-464a-87f3-a75b862e43bf None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:46.346496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34a083e5-16a1-464a-87f3-a75b862e43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:46.462204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:46.488509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 706/1402] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:46.796967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:46.798792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:47.014045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b814df-068d-4321-b294-81a85fcc5d4c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:47.074225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:47.190673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:47.191575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:47.192049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:47.192496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:47.194863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:47.348686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:47.353207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2502-236e-4775-89e5-231f43edb834 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:47.391411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 697/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:49.727982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:49.728842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:49.728842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:49.730195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 707/1404] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:49.736496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431a1b-dad5-4b4c-8b99-958d27bc290f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:49.737254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431a1b-dad5-4b4c-8b99-958d27bc290f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:49.737254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431a1b-dad5-4b4c-8b99-958d27bc290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:49.838314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:49.855971 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8431a1b-dad5-4b4c-8b99-958d27bc290f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:49.858878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8431a1b-dad5-4b4c-8b99-958d27bc290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:50.024836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 698/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:50.330771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:50.332391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:50.562765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec301b-05e1-4b10-9a1b-fce3ee42900c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:50.651045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:50.740424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:50.741288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:50.741288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:50.741641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:50.744018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:50.846713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:50.848264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc631-acc2-42ce-a98f-ad8d75eef98a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:50.891849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 708/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:37:53.119983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:53.120572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:53.120799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:53.123444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 699/1407] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:37:53.127676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291ef9-d799-4164-9f57-7f5c0d8d5c12 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:53.128102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291ef9-d799-4164-9f57-7f5c0d8d5c12 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:53.128300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291ef9-d799-4164-9f57-7f5c0d8d5c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:53.200062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-16291ef9-d799-4164-9f57-7f5c0d8d5c12 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:37:53.200900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16291ef9-d799-4164-9f57-7f5c0d8d5c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:53.224443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:53.314859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 709/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:37:53.617776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:37:53.619405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:53.762714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:53.795822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48d775-9a54-4d35-8e11-cb397296ca89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:37:53.954716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:37:53.956607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:37:53.957148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:37:53.957624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:37:53.967288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:37:54.084216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:54.088858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:37:54.090478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299966e-0564-49dd-9e1a-442b2fb904c2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:37:54.137335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 700/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:03.313066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=33 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:04.134835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:09.841928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed118f-7441-4e8b-b4af-f728824c57e1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:09.842464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed118f-7441-4e8b-b4af-f728824c57e1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:09.842464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed118f-7441-4e8b-b4af-f728824c57e1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:09.843872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 710/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 17:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:09.849037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827318-1404-45b2-909c-6eb7d6bd87e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:09.849495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827318-1404-45b2-909c-6eb7d6bd87e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:09.849600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827318-1404-45b2-909c-6eb7d6bd87e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:09.933441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b2827318-1404-45b2-909c-6eb7d6bd87e2 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:09.934667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2827318-1404-45b2-909c-6eb7d6bd87e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:10.042577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 701/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 17:38:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:10.057914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121139fb-c2b1-449f-993d-4d79e463db00 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:10.058240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121139fb-c2b1-449f-993d-4d79e463db00 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:10.058520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121139fb-c2b1-449f-993d-4d79e463db00 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:10.059923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 711/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 17:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:10.064464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8121e-67ba-4456-b4ea-a77473339821 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:10.064755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8121e-67ba-4456-b4ea-a77473339821 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:10.065033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8121e-67ba-4456-b4ea-a77473339821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:10.139510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:10.141974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f5a8121e-67ba-4456-b4ea-a77473339821 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:10.143222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5a8121e-67ba-4456-b4ea-a77473339821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:10.259215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 702/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 17:38:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:12.684630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:12.685206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:12.685206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:12.686506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:12.691835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e063-fb2e-47dc-936d-d34d17a86b99 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:12.692285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e063-fb2e-47dc-936d-d34d17a86b99 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:12.692417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e063-fb2e-47dc-936d-d34d17a86b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:12.760393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4937e063-fb2e-47dc-936d-d34d17a86b99 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:12.761622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4937e063-fb2e-47dc-936d-d34d17a86b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:12.822047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:12.864058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:38:13.157757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:13.159388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:13.304893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78002-4bd5-4318-ba36-395db532f676 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:13.378132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:13.419457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:13.419982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:13.420264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:13.420536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:13.422176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:13.512633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:13.514283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8575bca-bad0-4de8-9192-8ccb4e9e76ee service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:13.533944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 713/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:14.439672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:14.440215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:14.440215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:14.441638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:14.446754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb5ad-da03-4ab4-b5a7-c279b9c01afe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:14.447179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb5ad-da03-4ab4-b5a7-c279b9c01afe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:14.447390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb5ad-da03-4ab4-b5a7-c279b9c01afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:14.526033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-123eb5ad-da03-4ab4-b5a7-c279b9c01afe None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:14.527298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-123eb5ad-da03-4ab4-b5a7-c279b9c01afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:14.553861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:14.627975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:14.778674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:14.781446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:14.929294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1b68-bb8b-4891-84cd-14b6da32e331 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:14.971395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:15.047012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:15.047557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:15.047835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:15.048105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:15.049697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:15.138811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:15.140437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeed7e9-cb8e-42ef-8f9e-c29ce8fd75ca service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:15.158707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 705/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:16.068210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:16.068752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:16.068752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:16.070949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:16.075994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f971-b8fc-48d8-a103-1d0a3340f4c1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:16.076400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f971-b8fc-48d8-a103-1d0a3340f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:16.076543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7f971-b8fc-48d8-a103-1d0a3340f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:16.131776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:16.154886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1ef7f971-b8fc-48d8-a103-1d0a3340f4c1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:16.156204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ef7f971-b8fc-48d8-a103-1d0a3340f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:16.253207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:16.409441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:16.410887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:16.559272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9397a8-5c39-4461-8740-373101576c8c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:16.572606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:16.675540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:16.676067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:16.676351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:16.676621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:16.678272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:16.770198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:16.771834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72174-8969-4b71-bf95-86aaed31e731 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:16.790993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 716/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:17.665794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:17.666392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:17.666392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:17.667796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:17.672914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43455-1be7-441f-b260-203a7294fb81 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:17.673314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43455-1be7-441f-b260-203a7294fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:17.673462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43455-1be7-441f-b260-203a7294fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:17.693828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:17.756953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0da43455-1be7-441f-b260-203a7294fb81 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:17.758720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0da43455-1be7-441f-b260-203a7294fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:17.856584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:18.006577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:18.008767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:18.121442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:18.159294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b82240-870c-4fce-a91d-cb67b96de2c7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:18.273170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:18.273770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:18.274050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:18.274319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:18.275950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:18.352546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:18.365977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:18.368200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd753e-69c5-4565-9b01-fa221d6d9031 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:18.386566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 708/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:19.251430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:19.251987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:19.251987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:19.253378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:19.259744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff507-0dd0-4beb-bd55-a4c6280e5cc4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:19.260157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff507-0dd0-4beb-bd55-a4c6280e5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:19.260300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff507-0dd0-4beb-bd55-a4c6280e5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:19.338637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-484ff507-0dd0-4beb-bd55-a4c6280e5cc4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:19.339898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-484ff507-0dd0-4beb-bd55-a4c6280e5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:19.438796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:19.594927 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:19.596481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:19.683918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:19.745121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2deeda-ad8a-4d82-8cea-edb12fdb7409 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:19.865932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:19.867267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:19.867769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:19.868054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:19.869694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:19.919620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:19.963061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:19.964759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568bedf-9c6a-4811-b482-95cb8e69e1e2 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:19.983256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 719/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:20.875598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:20.876514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:20.876514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:20.878134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:20.884535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085e1b-b267-47ce-83a3-f781575bb2a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:20.884974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085e1b-b267-47ce-83a3-f781575bb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:20.885121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085e1b-b267-47ce-83a3-f781575bb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:20.965222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d0085e1b-b267-47ce-83a3-f781575bb2a3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:20.966501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d0085e1b-b267-47ce-83a3-f781575bb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:21.068724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:21.220721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:21.222274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:21.272441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:21.373719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dffa0-c8fe-4a53-8365-f6e4fac689f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:21.487479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:21.488009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:21.488295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:21.488575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:21.490180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:21.497799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:21.581537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:21.583185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d32591-0221-4d63-a491-ca87e9c5f88d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:21.602240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 711/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:22.515559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:22.516156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:22.516156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:22.517479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:22.522419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c27b9-3421-4de7-a9c5-75ed99353704 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:22.522957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c27b9-3421-4de7-a9c5-75ed99353704 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:22.523062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c27b9-3421-4de7-a9c5-75ed99353704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:22.601560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-663c27b9-3421-4de7-a9c5-75ed99353704 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:22.602785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-663c27b9-3421-4de7-a9c5-75ed99353704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:22.671900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:22.701858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:22.855200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:22.856645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:22.874936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:23.007211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e197c-8220-4ebe-9d1b-46acfced036a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:23.093899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:23.120535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:23.121088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:23.121402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:23.121675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:23.123337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:23.213631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:23.215273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660470a-5f55-4d41-9279-b2e7332ae9df service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:23.233582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 722/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:24.129873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:24.130465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:24.130465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:24.133221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:24.137737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ac07-8118-4eff-8fc7-f17bdab33ee9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:24.138213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ac07-8118-4eff-8fc7-f17bdab33ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:24.138422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ac07-8118-4eff-8fc7-f17bdab33ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:24.215443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7220ac07-8118-4eff-8fc7-f17bdab33ee9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:24.216718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7220ac07-8118-4eff-8fc7-f17bdab33ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:24.259959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:24.316417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:24.470634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:24.472125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:24.625358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8b66-af39-4db2-9c46-b514fb52df19 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:24.680286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:24.739958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:24.740486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:24.740762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:24.741034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:24.743207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:24.834244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:24.836591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e63a94-392d-4617-9e1a-1c64e4dcfdf6 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:24.855227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 714/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:25.734117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:25.734702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:25.734702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:25.736062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:25.740909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc068-7bec-46b5-b90a-a58561f4894d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:25.745111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc068-7bec-46b5-b90a-a58561f4894d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:25.745111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc068-7bec-46b5-b90a-a58561f4894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:25.820327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b70dc068-7bec-46b5-b90a-a58561f4894d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:25.821714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b70dc068-7bec-46b5-b90a-a58561f4894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:25.823822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:25.922648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:26.076845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:26.078365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:26.344385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6d252-48ba-4fc4-b24d-7533d27d626b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:26.371980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:26.458748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:26.459383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:26.459658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:26.460026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:26.461911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:26.551067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:26.552676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7fa85-f047-428f-a525-d0ad440b06fa service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:26.571997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 725/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:28.464125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:28.464689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:28.464689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:28.466136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:28.471412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a592d-449b-4114-9dad-e1290f0cfd57 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:28.471844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a592d-449b-4114-9dad-e1290f0cfd57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:28.471988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a592d-449b-4114-9dad-e1290f0cfd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:28.514326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:28.540786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-880a592d-449b-4114-9dad-e1290f0cfd57 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:28.541993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-880a592d-449b-4114-9dad-e1290f0cfd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:28.642162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:28.927794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:28.929496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:29.036066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21fd0-1bdb-4847-b405-fcea2ba5f4ff None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:29.070279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:29.111909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:29.112515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:29.112797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:29.113088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:29.114672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:29.227441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:29.228800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757f170-06d4-40a7-9627-5affe1a71bb6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:29.248113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 717/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:31.315462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:31.316028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:31.316028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:31.317359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:31.323306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb0012-7e03-4aec-8f66-52fc653cd6b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:31.323737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb0012-7e03-4aec-8f66-52fc653cd6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:31.323888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb0012-7e03-4aec-8f66-52fc653cd6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:31.391639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63bb0012-7e03-4aec-8f66-52fc653cd6b2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:31.392866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63bb0012-7e03-4aec-8f66-52fc653cd6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:31.406152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:31.491717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:31.773058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:31.774597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:31.879035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f6d5-dbb2-472b-8b38-92891166dafe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:31.891585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:31.961379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:31.962011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:31.962278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:31.962554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:31.964231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:32.079788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:32.081236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb5d0c-5f3f-4880-8e8a-3e5b51b33ceb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:32.100215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 728/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:34.518963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:34.519527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:34.519620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:34.520970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:34.527365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca19e-5c25-4139-bb93-070d33daa188 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:34.527813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca19e-5c25-4139-bb93-070d33daa188 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:34.527990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca19e-5c25-4139-bb93-070d33daa188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:34.576616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:34.595594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fc4ca19e-5c25-4139-bb93-070d33daa188 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:34.596813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc4ca19e-5c25-4139-bb93-070d33daa188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:34.694338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:34.987034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:34.988614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:35.094442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a7ba-a337-4d0a-82d0-6f030e321f19 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:35.136990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:35.171581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:35.172190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:35.172471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:35.172744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:35.174344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:35.285395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:35.286845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936176d5-0455-4ece-ad07-a216960432e6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:35.306881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 720/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:37.364447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:37.365064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:37.365064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:37.367335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:37.372772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52180-5750-4ce7-adc0-b6d2ca7ed7e9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:37.373196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52180-5750-4ce7-adc0-b6d2ca7ed7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:37.373305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52180-5750-4ce7-adc0-b6d2ca7ed7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:37.441413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fdb52180-5750-4ce7-adc0-b6d2ca7ed7e9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:37.442638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fdb52180-5750-4ce7-adc0-b6d2ca7ed7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:37.464456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:37.544339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:37.841519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:37.843054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:37.951009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a4b56-c6a2-408f-afa9-2b506f12415d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:37.972724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:38.029301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:38.029917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:38.030207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:38.030484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:38.032208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:38.143539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:38.144901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216104e-e505-4d94-9220-d08a400721c6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:38.164338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 731/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:40.167563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:40.168119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:40.168272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:40.169666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:40.175558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482843-1483-43d3-b27d-107604be179b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:40.176051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482843-1483-43d3-b27d-107604be179b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:40.176135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482843-1483-43d3-b27d-107604be179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:40.240591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:40.243254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5a482843-1483-43d3-b27d-107604be179b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:40.244479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a482843-1483-43d3-b27d-107604be179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:40.342474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:40.629982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:40.632754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:40.738645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db545-8ab9-44b4-89aa-1690173660f0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:40.792002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:40.817037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:40.817660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:40.817937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:40.818205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:40.820256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:40.931217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:40.932662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3f05-8f38-43c4-a926-f09e19338178 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:40.951630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 723/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:42.977532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:42.978070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:42.978343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:42.979900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:42.985996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072035d-866d-4333-8e71-c23f2c84dc7d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:42.986504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072035d-866d-4333-8e71-c23f2c84dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:42.986612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072035d-866d-4333-8e71-c23f2c84dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:43.056457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5072035d-866d-4333-8e71-c23f2c84dc7d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:43.057677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5072035d-866d-4333-8e71-c23f2c84dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:43.089039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:43.158176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:43.448709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:43.450330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:43.557337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac06c2e-ec7a-40b0-942b-4b1d751620b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:43.595932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:43.645106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:43.645738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:43.646019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:43.646291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:43.648709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:43.766847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:43.768361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87ca83-1c14-4167-98c1-6c65a29a94c2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:43.788696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 734/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:45.828379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:45.828925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:45.828925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:45.830335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:45.835871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359900cf-0cbe-452c-acc6-80f74754bb83 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:45.836293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359900cf-0cbe-452c-acc6-80f74754bb83 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:45.836407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359900cf-0cbe-452c-acc6-80f74754bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:45.902966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-359900cf-0cbe-452c-acc6-80f74754bb83 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:45.904290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-359900cf-0cbe-452c-acc6-80f74754bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:45.913230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:46.005620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:46.302638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:46.305225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:46.408451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f9f90-9159-491c-80bc-a9a727ac9a83 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:46.465295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:46.484295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:46.484901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:46.485179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:46.485448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:46.487124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:46.598943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:46.600424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e81e6d-9e78-462c-a0a5-f40e0d991aef service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:46.619011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 726/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:48.595444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:48.595925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:48.596041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:48.597345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:48.603255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cee53-379f-4df9-91d5-62be690b1c51 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:48.603750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cee53-379f-4df9-91d5-62be690b1c51 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:48.603850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cee53-379f-4df9-91d5-62be690b1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:48.671922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e8cee53-379f-4df9-91d5-62be690b1c51 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:48.673156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e8cee53-379f-4df9-91d5-62be690b1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:48.713405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:48.773074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:49.060436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:49.061993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:49.173335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb8927-7b85-4cfc-83e5-43bf65ecd10d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:49.212989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:49.249586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:49.250196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:49.250480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:49.250749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:49.253132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:49.369355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:49.370706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70d6b1-b3e8-4127-9b15-b036aa90a31e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:49.389245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 737/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:51.367182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:51.367734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:51.367734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:51.369596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:51.375215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a84a1-7b6d-4eca-aa47-2f4165331287 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:51.375661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a84a1-7b6d-4eca-aa47-2f4165331287 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:51.375774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a84a1-7b6d-4eca-aa47-2f4165331287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:51.442930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-491a84a1-7b6d-4eca-aa47-2f4165331287 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:51.444360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-491a84a1-7b6d-4eca-aa47-2f4165331287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:51.462225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:51.546603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:51.839579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:51.841205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:51.947694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d957-7c56-4c59-bf5e-16f454ea305c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:52.014259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:52.020873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:52.021473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:52.021749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:52.022019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:52.024183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:52.133437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:52.134784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0af8f-91b4-4d0e-8b8c-3142b5b8ddec service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:52.153683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 729/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:38:54.113746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ff67-d032-45ea-b410-b21638254401 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:54.114309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ff67-d032-45ea-b410-b21638254401 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:54.114309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ff67-d032-45ea-b410-b21638254401 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:54.115685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:38:54.121151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf479-cf99-4a62-82f9-63e146ad39f7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:54.121695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf479-cf99-4a62-82f9-63e146ad39f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:54.121695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf479-cf99-4a62-82f9-63e146ad39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:54.190049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-84faf479-cf99-4a62-82f9-63e146ad39f7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:38:54.191223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84faf479-cf99-4a62-82f9-63e146ad39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:54.240145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:54.289549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:38:54.578292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ff67-d032-45ea-b410-b21638254401 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:38:54.579899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7974ff67-d032-45ea-b410-b21638254401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:54.686666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ff67-d032-45ea-b410-b21638254401 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:38:54.735156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:54.762747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:38:54.763386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:38:54.763668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:38:54.763943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:38:54.765546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:38:54.879311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:38:54.880766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6494c-f04a-413e-889d-b546ff333870 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:38:54.900882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 740/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:04.288002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=22 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:04.898649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=66 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:14.637960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb316e81-c136-42d3-98fc-917b3c157af4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:14.638537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb316e81-c136-42d3-98fc-917b3c157af4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:14.638537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb316e81-c136-42d3-98fc-917b3c157af4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:14.639956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 731/1471] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:14.645197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc7cb-1b67-4fa2-a26e-8cdb08d77acb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:14.645607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc7cb-1b67-4fa2-a26e-8cdb08d77acb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:14.645726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc7cb-1b67-4fa2-a26e-8cdb08d77acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:14.715071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3b3bc7cb-1b67-4fa2-a26e-8cdb08d77acb None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:14.716339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b3bc7cb-1b67-4fa2-a26e-8cdb08d77acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:14.814267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 741/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:15.116246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:15.116540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:15.116829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:15.118196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 732/1473] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:15.123174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a8a-712b-4754-a4e5-ba4c144aba05 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:15.123470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a8a-712b-4754-a4e5-ba4c144aba05 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:15.123749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a8a-712b-4754-a4e5-ba4c144aba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:15.200235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-48547a8a-712b-4754-a4e5-ba4c144aba05 None None] MFA Rules not processed for user `e4e90e02cb2741c6bda1ecd01d92cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:15.201499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-48547a8a-712b-4754-a4e5-ba4c144aba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:15.222669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:15.280316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 742/1474] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 17:39:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:15.288296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:15.289828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:15.394183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91aac-5659-48ea-9bd9-24a25a7c2b92 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:15.467907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:15.468512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:15.468788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:15.469056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:15.470674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:15.527498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:15.582952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:15.585095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ea73-2b1f-4c6c-bdd2-f8b4405d73b1 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:15.604752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 733/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:17.634419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:17.634978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:17.634978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:17.636366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 743/1476] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:17.641871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d4ded-c645-48c0-bc99-1bdfa812c637 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:17.642324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d4ded-c645-48c0-bc99-1bdfa812c637 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:17.642502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d4ded-c645-48c0-bc99-1bdfa812c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:17.713917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d58d4ded-c645-48c0-bc99-1bdfa812c637 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:17.715203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d58d4ded-c645-48c0-bc99-1bdfa812c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:17.812920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 734/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:18.094935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:18.096507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:18.225834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1384-7a37-4efb-aac5-f3ef550f10f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:18.274562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:18.319996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:18.320704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:18.321046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:18.321325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:18.321972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:18.323757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:39:18.323757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:39:18.323757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:39:18.324903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8e61b-4540-4e1a-8eb9-3bab652b3c0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:18.343992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 744/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 17:39:18 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:39:20.350533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:20.351140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:20.351140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:20.352474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 735/1479] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:20.357834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcfed6-2332-4c40-8872-07c5e001affa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:20.358290 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcfed6-2332-4c40-8872-07c5e001affa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:20.358402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcfed6-2332-4c40-8872-07c5e001affa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:20.424510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a6fcfed6-2332-4c40-8872-07c5e001affa None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:20.425737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a6fcfed6-2332-4c40-8872-07c5e001affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:20.524722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 745/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:20.827851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:20.829389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:20.839868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:20.976920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc73ee-8758-4005-b86e-ce0c5d45c755 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:21.060913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:21.093956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:21.094588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:21.094871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:21.095177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:21.096782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:21.187458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:21.189052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77821073-4703-4e92-afd5-5cd2af992773 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:21.207922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 736/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:23.322597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:23.323185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:23.323185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:23.324517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 746/1482] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:23.329890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510101c-7a1d-4e46-8f0d-da761cabdd48 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:23.330295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510101c-7a1d-4e46-8f0d-da761cabdd48 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:23.330441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510101c-7a1d-4e46-8f0d-da761cabdd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:23.396236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b510101c-7a1d-4e46-8f0d-da761cabdd48 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:23.397442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b510101c-7a1d-4e46-8f0d-da761cabdd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:23.445731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:23.496784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 737/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:23.790851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:23.792514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:23.817014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:23.897830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e24c-7490-4f54-b152-9d8df30728b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:23.974409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:23.975027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:23.975334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:23.975611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:23.977381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:24.054827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:24.089991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:24.091465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0cb1e-9004-4523-8f8e-8ac429473268 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:24.109538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 747/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:26.116909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:26.117474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:26.117474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:26.118808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 738/1485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:26.124269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd2b7-2360-4401-9c14-fe3f78af2670 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:26.124696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd2b7-2360-4401-9c14-fe3f78af2670 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:26.124826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd2b7-2360-4401-9c14-fe3f78af2670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:26.191150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-471bd2b7-2360-4401-9c14-fe3f78af2670 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:26.192358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-471bd2b7-2360-4401-9c14-fe3f78af2670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:26.290503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 748/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:26.579435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:26.580968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:26.687703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c754b9-1279-4dac-a19f-c77153f2ef83 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:26.761071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:26.762868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:26.763516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:26.763802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:26.764079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:26.765817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:26.879785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:26.881457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cc05-62fa-4dcb-9c57-3d62f057c5f0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:26.900362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 739/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:28.925560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:28.926086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:28.926086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:28.928072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 749/1488] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:39:28.933779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed996-86a0-4fa4-b2d5-d14acc593dc6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:28.934209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed996-86a0-4fa4-b2d5-d14acc593dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:28.934363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed996-86a0-4fa4-b2d5-d14acc593dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:29.001696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f08ed996-86a0-4fa4-b2d5-d14acc593dc6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:29.002918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f08ed996-86a0-4fa4-b2d5-d14acc593dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:29.057462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:29.101729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 740/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:39:29.389928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:29.391509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:29.428264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:29.496882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800876f2-2ee5-48c6-ae41-137de753636d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:29.573649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:29.574273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:29.574549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:29.574817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:29.576446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:29.661097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:29.692022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:29.694072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacc4e4-bf09-4e0d-99f9-95fea7bc7750 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:29.712172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 750/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:32.227662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:32.228218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:32.228218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:32.229576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 741/1491] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 17:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:39:32.235410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686446b9-7cf8-4c81-8843-2fd77fd2c8a8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:32.235856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686446b9-7cf8-4c81-8843-2fd77fd2c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:32.235954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686446b9-7cf8-4c81-8843-2fd77fd2c8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:32.303489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-686446b9-7cf8-4c81-8843-2fd77fd2c8a8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:39:32.304987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-686446b9-7cf8-4c81-8843-2fd77fd2c8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:32.400858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 751/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:39:32.692159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:39:32.694078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:32.800626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346e963-1e29-40c4-9db8-51a4d8aab762 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:39:32.876683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:39:32.877204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:39:32.877490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:39:32.877764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:39:32.879392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:39:32.889130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:32.993931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:39:32.995410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6da8b-ce3d-4588-9d99-7412fe3c7c1c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:39:33.013719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 742/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:39:42.398965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:43.050701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=50 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:56.266168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:56.266782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:56.266782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:56.348438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:40:56.349673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:56.451823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 752/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:40:56.460748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:56.461329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:56.461329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:56.540111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:40:56.541244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:56.641632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 743/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:40:56.647068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:56.648312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:56.660188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1410a5a-a1b2-4d56-b175-72048fd7ad6f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:56.724512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:56.760849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:56.761449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:56.761725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:56.761995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:56.762633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:40:56.762930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:56.763966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:56.763966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:40:56.763966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:40:56.764842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:56.777572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 753/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:40:56.786139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:56.795503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bb8d2-fe44-4657-abb4-743db7e5500c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:56.863576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:56.899689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:56.900297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:56.900602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:56.901092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:56.902249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:56.904087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:56.904087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:40:56.904087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:40:56.905279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:57.021640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 744/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:40:57.026331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:57.027937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:57.064207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf497dd-3b91-482b-a5cf-7df7bede8a93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:57.161057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:57.161659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:57.161938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:57.162215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:57.162846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:57.163887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:57.163887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:40:57.163887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:40:57.165096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:57.287744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 754/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:40:57 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:40:57.291842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:57.293373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:57.356412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d970a-82cd-4dad-af46-6d6470fa15f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:57.440609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:57.451466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:57.452082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:40:57.455221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:57.469322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 745/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:40:57.473536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:57.475108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:57.486464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55c90-19b1-4cdf-98e6-0dad4c7e190d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:57.512626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:57.584326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:57.584939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:57.585224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:57.585502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:57.586148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:57.587209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:57.587209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:40:57.587209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:40:57.588107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b09b9-bd13-436a-a708-8bdff1bba8e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:57.601330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 755/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:40:57.612212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:57.614032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:57.649116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7692a2-1ccf-4efb-a6f9-ae810ac36f52 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:57.747058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:57.747744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:57.748022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:57.748294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] PATH_INFO: `/v3/projects/84cc40b24f4b4d4cafa248575cc8e4ac/users/1a73eaec90954c9aae52c1d81e7019de/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:57.771220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cc40b24f4b4d4cafa248575cc8e4ac, user_id=1a73eaec90954c9aae52c1d81e7019de, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:57.772253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:57.772253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:40:57.772253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:40:57.774195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f40e9b-4f00-4731-81ce-2acd75d151b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:57.852237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 746/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:40:57 2022] PUT /identity/v3/projects/84cc40b24f4b4d4cafa248575cc8e4ac/users/1a73eaec90954c9aae52c1d81e7019de/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:40:57.865118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665258b-2a1c-436a-913b-5557a4aa8c0d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:57.865317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665258b-2a1c-436a-913b-5557a4aa8c0d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:57.865589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665258b-2a1c-436a-913b-5557a4aa8c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:57.922888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8665258b-2a1c-436a-913b-5557a4aa8c0d None None] MFA Rules not processed for user `1a73eaec90954c9aae52c1d81e7019de`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:40:57.924155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8665258b-2a1c-436a-913b-5557a4aa8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:58.005604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 756/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:40:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:40:58.018869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:58.019241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:58.019458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:58.020848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 747/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 17:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:40:58.025837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4abb22-081a-46de-ba22-6cb989490bf7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:58.026136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4abb22-081a-46de-ba22-6cb989490bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:58.026406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4abb22-081a-46de-ba22-6cb989490bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:58.059586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:58.109150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fb4abb22-081a-46de-ba22-6cb989490bf7 None None] MFA Rules not processed for user `070d1f13e4954e999ae30434d4df6d42`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:40:58.110377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb4abb22-081a-46de-ba22-6cb989490bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:58.198432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 757/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:40:58.205467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:58.207935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:58.259863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:58.315670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898241c-27c5-4aba-8591-f594cd605ed4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:58.389851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:58.390449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:58.390729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:58.391017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:58.392632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:58.492516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:58.493879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:58.497408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:58.512986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 748/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:40:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:40:58.558938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaaa32-2053-4366-9ed4-4de58d3f17ef None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:58.559435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaaa32-2053-4366-9ed4-4de58d3f17ef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:58.559537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaaa32-2053-4366-9ed4-4de58d3f17ef None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:58.560783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 758/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Aug 24 17:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:40:58.564533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:58.566423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:58.670989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d7c47-564d-4abb-a26e-e7607d23c30b service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:58.769756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:58.770387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:58.770666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:58.770938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] PATH_INFO: `/v3/users/1a73eaec90954c9aae52c1d81e7019de` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:58.784216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a73eaec90954c9aae52c1d81e7019de)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:58.786082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:40:58.786082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:40:58.786082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:40:58.787612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:58.798400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:59.022151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a73eaec90954c9aae52c1d81e7019de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:40:59.022610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a73eaec90954c9aae52c1d81e7019de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:40:59.023030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a73eaec90954c9aae52c1d81e7019de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:40:59.039451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a73eaec90954c9aae52c1d81e7019de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:40:59.113762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a73eaec90954c9aae52c1d81e7019de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:40:59.145794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 749/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:40:58 2022] DELETE /identity/v3/users/1a73eaec90954c9aae52c1d81e7019de => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:40:59.150264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:59.150547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:59.150824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:59.215716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:40:59.216954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:59.294271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:59.307494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 759/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:40:59.318153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:40:59.319410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:59.426784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d82a8-3da8-44b4-b35b-accd0bc1a716 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:40:59.486269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:59.508028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:40:59.510511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:40:59.510511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:40:59.510511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:40:59.510841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:40:59.627119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:40:59.628820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1e34-923c-49f2-bab0-beb05933c775 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:40:59.648291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 750/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:41:00.186038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:41:00.187604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:41:00.201532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1a933-6552-4f69-9277-52a6ac1b2e74 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:41:00.313517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:41:00.314148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:41:00.314421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:41:00.314691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] PATH_INFO: `/v3/projects/84cc40b24f4b4d4cafa248575cc8e4ac` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:41:00.326011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84cc40b24f4b4d4cafa248575cc8e4ac)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:41:00.327041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:00.327041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:41:00.327041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:41:00.328272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:41:00.450987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84cc40b24f4b4d4cafa248575cc8e4ac', 'request_id': 'req-66eb825c-a8e3-4376-83c7-2524193b2024'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:41:00.457669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84cc40b24f4b4d4cafa248575cc8e4ac', 'request_id': 'req-66eb825c-a8e3-4376-83c7-2524193b2024'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:41:00.527347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84cc40b24f4b4d4cafa248575cc8e4ac', 'request_id': 'req-66eb825c-a8e3-4376-83c7-2524193b2024'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:41:00.560880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] The token cache is being invalidate because project 84cc40b24f4b4d4cafa248575cc8e4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:41:00.561167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:41:00.561720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66eb825c-a8e3-4376-83c7-2524193b2024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:41:00.563013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 760/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:41:00 2022] DELETE /identity/v3/projects/84cc40b24f4b4d4cafa248575cc8e4ac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:41:09.645826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=62 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:10.558682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:32.849778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:32.850346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:32.850346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:32.851639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:32.856544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4cfa-5d12-4482-9ee0-ea71316ae090 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:32.857005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4cfa-5d12-4482-9ee0-ea71316ae090 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:32.857112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4cfa-5d12-4482-9ee0-ea71316ae090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:32.953458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74ab4cfa-5d12-4482-9ee0-ea71316ae090 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:32.955783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74ab4cfa-5d12-4482-9ee0-ea71316ae090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:33.092818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:33.247772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:33.250088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:33.389130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa13c9-64bf-4fdf-8df4-88458aa2e8f1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:33.397848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:33.398459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:33.398741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:33.399125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:33.408323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:33.410146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c4a0-b350-4997-aa1a-3ce52d767ba7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:33.420227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 752/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:42:34.284306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7702f0-d0f3-42c0-a2bb-24b679e50adc None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:34.284918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7702f0-d0f3-42c0-a2bb-24b679e50adc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:34.284918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7702f0-d0f3-42c0-a2bb-24b679e50adc None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:34.286300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:34.291871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d986a-893a-4e0d-938b-91a7619c7aef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:34.292609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d986a-893a-4e0d-938b-91a7619c7aef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:34.292609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d986a-893a-4e0d-938b-91a7619c7aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:34.314441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f95d986a-893a-4e0d-938b-91a7619c7aef None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:34.315709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f95d986a-893a-4e0d-938b-91a7619c7aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:34.323790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:34.482259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7702f0-d0f3-42c0-a2bb-24b679e50adc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:34.502083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7702f0-d0f3-42c0-a2bb-24b679e50adc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:34.510893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:34.511947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:34.512575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:34.513068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:34.524928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:34.526860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a331-06e1-418e-b62d-2cd5017987ff service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:34.538092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 763/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:35.305793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaea40-7b7e-4e4f-9490-f7b7b656b982 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:35.306377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaea40-7b7e-4e4f-9490-f7b7b656b982 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:35.306377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaea40-7b7e-4e4f-9490-f7b7b656b982 None None] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:35.307760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 754/1517] 10.222.0.16 () {54 vars in 925 bytes} [Wed Aug 24 17:42:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:42:35.314971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd994d5-b122-4e3a-aeb7-a25358e8e31b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:35.315965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd994d5-b122-4e3a-aeb7-a25358e8e31b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:35.315965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd994d5-b122-4e3a-aeb7-a25358e8e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:35.379690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3bd994d5-b122-4e3a-aeb7-a25358e8e31b None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:35.380911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3bd994d5-b122-4e3a-aeb7-a25358e8e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:35.398149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:35.454807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 764/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Aug 24 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:39.667225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa6a3-4306-4e21-b319-78c2b24aa5b6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:39.667807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa6a3-4306-4e21-b319-78c2b24aa5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:39.667807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa6a3-4306-4e21-b319-78c2b24aa5b6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:39.669351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 755/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 17:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:39.674978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7264-46a9-4e40-9952-ccc0fa94dc52 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:39.675471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7264-46a9-4e40-9952-ccc0fa94dc52 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:39.675589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7264-46a9-4e40-9952-ccc0fa94dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:39.695461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8aeb7264-46a9-4e40-9952-ccc0fa94dc52 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:39.696671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8aeb7264-46a9-4e40-9952-ccc0fa94dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:39.705998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 765/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:39.713757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa6a3-4306-4e21-b319-78c2b24aa5b6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:39.727610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa6a3-4306-4e21-b319-78c2b24aa5b6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:39.732539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:39.733136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:39.733413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:39.733684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:39.742416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:39.744090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798fef2-6070-4271-a333-50de2c07cf9f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:39.754331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 756/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:45.769673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df27d-8b44-4872-aa1b-aa1ce33c2c30 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:45.770216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df27d-8b44-4872-aa1b-aa1ce33c2c30 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:45.770216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df27d-8b44-4872-aa1b-aa1ce33c2c30 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:45.771673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:45.776864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5210f-862e-4595-bbd8-e0cbf04d7457 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:45.777570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5210f-862e-4595-bbd8-e0cbf04d7457 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:45.777570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5210f-862e-4595-bbd8-e0cbf04d7457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:45.799921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33f5210f-862e-4595-bbd8-e0cbf04d7457 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:45.801156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33f5210f-862e-4595-bbd8-e0cbf04d7457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:45.810054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:45.967213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df27d-8b44-4872-aa1b-aa1ce33c2c30 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:45.982458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df27d-8b44-4872-aa1b-aa1ce33c2c30 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:45.988893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:45.989508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:45.989786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:45.990061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:45.998976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:46.001241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58bcb-baba-4cca-965c-6c1bcd72287a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:46.012475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 767/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:42:46.842838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102ed1-714e-487a-87a2-acd7185e1a8e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:46.843485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102ed1-714e-487a-87a2-acd7185e1a8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:46.843485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102ed1-714e-487a-87a2-acd7185e1a8e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:46.844850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:46.849715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd892-ca9e-4c8a-87fc-1fdb191d2e41 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:46.850132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd892-ca9e-4c8a-87fc-1fdb191d2e41 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:46.850265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd892-ca9e-4c8a-87fc-1fdb191d2e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:46.869547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9fafd892-ca9e-4c8a-87fc-1fdb191d2e41 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:46.870760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9fafd892-ca9e-4c8a-87fc-1fdb191d2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:46.879593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:42:47.038953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102ed1-714e-487a-87a2-acd7185e1a8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:47.054378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102ed1-714e-487a-87a2-acd7185e1a8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:47.059875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:47.060486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:47.060761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:47.061027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:47.069862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:47.071509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef11fe-cd5c-4212-bb51-fd027a80079b service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:47.081530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 759/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:50.956376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:50.956986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:50.956986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:50.958314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:50.964053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701237-2176-4ff3-b9b1-d5565afa3735 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:50.965062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701237-2176-4ff3-b9b1-d5565afa3735 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:50.965062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701237-2176-4ff3-b9b1-d5565afa3735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:50.986408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee701237-2176-4ff3-b9b1-d5565afa3735 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:50.988013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee701237-2176-4ff3-b9b1-d5565afa3735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:50.996160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:51.286757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:51.288563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:51.368746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7916-53b8-4cd4-8013-f177b5dcb1fa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:51.372351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:51.372957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:51.373240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:51.373517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:51.382844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:51.384316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b008bc-08f1-4604-86c4-42e5541c8abf service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:51.394453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 770/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:53.331563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fbc-e8ae-4a40-8fa4-92f7a1c55a7b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:53.332136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fbc-e8ae-4a40-8fa4-92f7a1c55a7b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:53.332136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fbc-e8ae-4a40-8fa4-92f7a1c55a7b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:53.333476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:53.338913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfeef-18cd-479e-870a-31985c763b54 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:53.339354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfeef-18cd-479e-870a-31985c763b54 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:53.339634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfeef-18cd-479e-870a-31985c763b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:53.360317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6edfeef-18cd-479e-870a-31985c763b54 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:53.361097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6edfeef-18cd-479e-870a-31985c763b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:53.368849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:53.655734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a7fbc-e8ae-4a40-8fa4-92f7a1c55a7b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:53.667194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a7fbc-e8ae-4a40-8fa4-92f7a1c55a7b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:53.670816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:53.671457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:53.675920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:53.675920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:53.682509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:53.683999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cdcfa-60da-444a-8484-a8157b65ad38 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:53.694753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 762/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:42:57.061825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:57.062392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:57.062511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:57.064146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:57.069509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031d05-2103-4709-8aa4-9edd34f57f04 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:57.069960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031d05-2103-4709-8aa4-9edd34f57f04 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:57.070077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031d05-2103-4709-8aa4-9edd34f57f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:57.089197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-66031d05-2103-4709-8aa4-9edd34f57f04 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:57.090412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-66031d05-2103-4709-8aa4-9edd34f57f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:57.099356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:42:57.670862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:42:57.673719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:57.739282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:57.752999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b235af-8553-4fe7-a068-80c0f09bd87a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:42:57.756905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:42:57.757583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:57.757860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:57.758131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:57.768052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:42:57.769547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f148b-3715-40ac-a5bb-954f6c373035 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:42:57.779368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 773/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:59.738591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:59.739192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:59.739192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:59.740530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:42:59.745947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb990-a315-4614-b2b2-3e3cffe0a6e5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:42:59.746396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb990-a315-4614-b2b2-3e3cffe0a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:42:59.746507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb990-a315-4614-b2b2-3e3cffe0a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:42:59.766882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c8cb990-a315-4614-b2b2-3e3cffe0a6e5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:42:59.768419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c8cb990-a315-4614-b2b2-3e3cffe0a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:42:59.776068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:43:00.333758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:43:00.335502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:43:00.343043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:00.349208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7eead-f313-4d3e-8ee3-261a352a2985 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:43:00.352725 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:43:00.353322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:43:00.353631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:43:00.353917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:43:00.364235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:43:00.365775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42df3ef-c6b7-49bc-ba12-69846879222e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:43:00.377001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 765/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:43:09.762002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:10.377972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:30.971450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e845b4-ebce-4cc1-b7de-ac65a4eb288b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:30.972251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e845b4-ebce-4cc1-b7de-ac65a4eb288b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:30.972251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e845b4-ebce-4cc1-b7de-ac65a4eb288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.018673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a8e845b4-ebce-4cc1-b7de-ac65a4eb288b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.021219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a8e845b4-ebce-4cc1-b7de-ac65a4eb288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.036821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 775/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:31.047399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.048347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.048795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.075352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fb4d-cd63-49c5-af06-2febdf05166e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.076238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fb4d-cd63-49c5-af06-2febdf05166e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.076679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fb4d-cd63-49c5-af06-2febdf05166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.078625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.079915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.098447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 766/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:31.103275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.107419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c909fb4d-cd63-49c5-af06-2febdf05166e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.109974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c909fb4d-cd63-49c5-af06-2febdf05166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.120126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e14d9e-5993-44ee-8404-9a58d8a42700 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.127704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 776/1542] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:31.129261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f04b-e75e-4926-a236-eb056e5cbbf2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.129864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f04b-e75e-4926-a236-eb056e5cbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.130298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f04b-e75e-4926-a236-eb056e5cbbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.130878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.131541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.131829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.133043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.133776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.134088 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.136821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:31.136821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:44:31.136821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:44:31.136821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8746c3-96f2-416c-8222-46bb8afd6f06 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.164323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 767/1543] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:44:31.166572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.166793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.167067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.172230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29b0f04b-e75e-4926-a236-eb056e5cbbf2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.173725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29b0f04b-e75e-4926-a236-eb056e5cbbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.200563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 777/1544] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.204481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a47e-1783-4f91-997a-ee2389e6fc89 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.204812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a47e-1783-4f91-997a-ee2389e6fc89 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.205037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a47e-1783-4f91-997a-ee2389e6fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.207777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.209087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.221037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 768/1545] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.222280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.233756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e7f7a47e-1783-4f91-997a-ee2389e6fc89 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.234993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7f7a47e-1783-4f91-997a-ee2389e6fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.236746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe5542-cee4-4e04-83b2-20b1fa2f72fa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.242795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.243744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.244201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.244401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 778/1546] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.244920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.245782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb259-fc95-4092-ad12-d36d9f467d11 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.246605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb259-fc95-4092-ad12-d36d9f467d11 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.246892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb259-fc95-4092-ad12-d36d9f467d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.247017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.249521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025f31-316f-4c72-a678-f0aa42f56846 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.268455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4dffb259-fc95-4092-ad12-d36d9f467d11 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.269685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4dffb259-fc95-4092-ad12-d36d9f467d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.282818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 779/1547] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.282818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371beba-187f-4ffe-86a5-622b9586aef3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.282818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371beba-187f-4ffe-86a5-622b9586aef3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.282818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371beba-187f-4ffe-86a5-622b9586aef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.312714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d371beba-187f-4ffe-86a5-622b9586aef3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.314251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d371beba-187f-4ffe-86a5-622b9586aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.323535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 780/1548] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.325557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4919-bc54-4320-897c-7e293c98586c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.325846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4919-bc54-4320-897c-7e293c98586c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.326124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4919-bc54-4320-897c-7e293c98586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.346515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-563e4919-bc54-4320-897c-7e293c98586c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.347752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-563e4919-bc54-4320-897c-7e293c98586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.356812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 781/1549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.357547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e4919-bc54-4320-897c-7e293c98586c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.367214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e4919-bc54-4320-897c-7e293c98586c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.372514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.373127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.373411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.373687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.374508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.374827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.376477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876677-8ace-41b5-9a23-0efc53541e95 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.381993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 769/1550] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:31.386786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c289a20-2e06-44a7-bf0f-61aad935ee68 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.386786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c289a20-2e06-44a7-bf0f-61aad935ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.387801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c289a20-2e06-44a7-bf0f-61aad935ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.396331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 782/1551] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:31.397692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981eed-6583-4b20-be37-8901795e0393 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.398068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981eed-6583-4b20-be37-8901795e0393 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.398346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981eed-6583-4b20-be37-8901795e0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.409270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1c289a20-2e06-44a7-bf0f-61aad935ee68 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.410512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c289a20-2e06-44a7-bf0f-61aad935ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.420051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0f981eed-6583-4b20-be37-8901795e0393 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.421540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f981eed-6583-4b20-be37-8901795e0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.473845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 770/1552] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.475006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.475339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.475622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.485032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 783/1553] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.485032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.485032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.485032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.498497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.500475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.512734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.512945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 771/1554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.514254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.514650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.527600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 784/1555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.531134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985760-5e04-4480-b333-7f812ff0af08 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.532282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.537003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.537986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.538270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.538554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.539316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.539623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.541263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca5881-0af3-4c30-bd78-2df9c878a675 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.543255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0700-f521-41f8-807a-796fe99ab857 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.548543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.549206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.549490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.549771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.550405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.552391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.554915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 772/1556] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:31.556189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.556474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.556814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.577339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.578587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.586705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 773/1557] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.587503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.597921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977901e0-3d03-4b5d-b7a9-986337639a18 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.602560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.603197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.603480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.603751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.604368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.606926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94b7bb-ec47-496e-96e5-55a38c9449ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.694285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 785/1558] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:31.695217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.705312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884701-617a-4cb6-bf10-c7c647b40983 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.709970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.710570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.710833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.711135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.711779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.712080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.713670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.727017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 786/1559] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:31.727819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.739386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 774/1560] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:31.739386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.739386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.739386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.739811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366b92e-3901-4209-8b58-04179d337d36 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.759208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.760464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.796815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.797444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.797728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.798006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.798664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.798971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.800627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.808296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:31.813042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:31.813956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 787/1561] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:31.816001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.826026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5ca0-fa3c-4f6d-a237-4acd451d834e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.826789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 775/1562] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.827665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.831270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.831879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.832160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.832432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.833073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:31.833382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.835044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e167d53-f558-4be5-ba0b-f081f1c30031 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.837076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c2c84-3d20-4230-8639-1342c52cd3dc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.842740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.843390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.843673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.843947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.844575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.846489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.850192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 788/1563] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:31.851293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.851567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.851840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.871770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:31.877253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:31.880991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 789/1564] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:31.881772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.892213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c8c1-c911-43a1-ae64-e9f6902980c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.896983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.897556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.897827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.898097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.898732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.900493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.912070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 790/1565] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:31.915741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 776/1566] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:31.915843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.915926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:31.927395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c89d4-b05c-477f-81ff-3d352cbdda46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.987451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251a84-366e-477d-8734-e311c7c72c03 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:31.987683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.988149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.988371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.988735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.989458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.990512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:31.990512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:44:31.990512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:44:31.991891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:31.992250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:31.992919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:31.993198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:31.993496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:31.994149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:31.995176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:31.995176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:44:31.995176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:44:31.997064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.095566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 791/1567] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.096420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.123679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 777/1568] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:31 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.126881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.135027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda289ea-eb8d-4b19-b80b-8c723bb604d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.163465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfd23e-516e-446a-9a89-a107035e034e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.168193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.168813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.169095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.169364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.169994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.172203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.194630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.199432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.211268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 778/1569] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:32.212130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.222515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c0b6f-8550-45bc-9f38-66d194f53162 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.227100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.227693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.227977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.228254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.228868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.230908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.263444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 792/1570] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.263444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.304866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:32.322025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 779/1571] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.322025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.328246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8128a-e955-4429-a11c-52bad32178bc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.364969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:32.390919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa244-04c9-49c4-b81d-2920ff8c0963 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.391875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.392177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.392462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.392735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.393425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:32.393718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.395646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.396374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.397042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.397500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.397813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.398483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.400187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.409674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 793/1572] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:32.410688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.416415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 780/1573] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:32.416415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.424117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664756-1e3f-42cf-a59c-dcf163604cd5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.428157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433355b-35ce-4d8d-96f7-abf97af0276c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.429072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.429708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.430028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.430330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.430978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.433176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.433676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.434860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.435455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.435647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.436342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.438343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.563624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 794/1574] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.564522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.575211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9b78-a990-413d-b085-f2e81bee5111 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.581041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.581687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.582028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.582307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.582951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.584603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.595814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 795/1575] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:32.598220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.598501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 781/1576] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.600313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.607859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af868391-4df4-447a-879e-2f7d2e92b4ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.611361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2621-2bac-4b4a-8a20-296d157712ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.612793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.613406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.613685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.613957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.614578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.616245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.616539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.616861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.617175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.617614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.618162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.620144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.727991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 796/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.732105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.737231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 782/1578] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.741841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.751494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c966c-7b4c-41c5-a21b-441ba39f312d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.800458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f8b-453a-4ac1-aee9-b53cdbd5cee1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.805123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.805733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.806010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.806455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.806905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.808886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.813109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.813838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.814067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.814342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] PATH_INFO: `/v3/projects/0dfcf993fd3c4344b486801feb222f63/users/924185a6e69b4e9aa8bcc456c096015e/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.829875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfcf993fd3c4344b486801feb222f63, user_id=924185a6e69b4e9aa8bcc456c096015e, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:32.833047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:32.916727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 797/1579] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:32.917619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.929149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 783/1580] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:32 2022] PUT /identity/v3/projects/0dfcf993fd3c4344b486801feb222f63/users/924185a6e69b4e9aa8bcc456c096015e/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:32.929980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:32.933470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b006e-5d69-409c-bf86-f2a03f6307a8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.949352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:32.997938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:32.998671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d4a8-7281-4e5b-9c60-8402ee10dd0f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:32.998804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:32.998917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:32.999205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:32.999980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.001922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.003257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.003873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.004172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.004434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.005078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.006786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.018663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 784/1581] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.019566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.030627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ecfa6-3e99-41c4-ae6f-586c7dd471f9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.035592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.036263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.036664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.036942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.037613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.039345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.052170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 785/1582] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.053009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.059424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:33.063406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959de3-4d2d-4eaf-b1c6-de3a61975fb4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.068443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.068964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.069246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.069517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.070155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.071784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.082374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 786/1583] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.085383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.093748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99802048-0549-4b99-8384-4967e5257930 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.098596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.099033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.099383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.099699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.100226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.102154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.113102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 798/1584] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:32 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:33.114157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.178371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63de92-bce8-43a7-aefd-4cbcfc771ced admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.183069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.183700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.183978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.184249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.185001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.186606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.197130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 799/1585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.197959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.207745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f03df-640d-4be5-8cd3-5e1a4aa3ed68 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.212442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.213041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.213317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.213590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.214223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.216458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200304d-c7bd-4e91-9f62-db36abd17c1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.231157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 800/1586] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.231412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 787/1587] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:33 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:33.231412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.232432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.232432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.232432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.241966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265be-448d-46ca-9cdf-f2f1cc0639ea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.246717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.249236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.249236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.249236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.249236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.250415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:33.250535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.251809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:33.259291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 801/1588] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:33.260074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.267840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 788/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.267840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.270053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a596-46db-4c9e-b5d9-f1d6864fa718 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.275227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.278023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.278023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.278023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] PATH_INFO: `/v3/projects/a9c886c2349b4ea0a34b78d80737c4ce/users/5153ddc5d5e4480a81e636fba58821d5/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.278881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a39b2-8e42-4410-97f9-12f44df8d9a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.282358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.282974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.283290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.283560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.284194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.285796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.292770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c886c2349b4ea0a34b78d80737c4ce, user_id=5153ddc5d5e4480a81e636fba58821d5, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.294440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:33.294440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:44:33.294440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:44:33.296889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.298016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 789/1590] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.299779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.310578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab597-885c-4376-a5bc-ee5a4c0b906e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.315430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.316036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.316316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.316592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.317238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.319284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.396525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 802/1591] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:33 2022] PUT /identity/v3/projects/a9c886c2349b4ea0a34b78d80737c4ce/users/5153ddc5d5e4480a81e636fba58821d5/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:33.397470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.430111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 790/1592] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:33 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:33.434070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.444263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f806-307b-482e-8fb6-d99aeae39b8f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.463598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:33.468597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604754a-2647-4ad5-b4dc-70a4ee2f0540 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.473991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.474609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.474931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.475177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.475822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.477440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.488211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 803/1593] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.489044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.498601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32f40-19d8-45bf-81ae-f9d67a4ad097 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.503233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.503835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.504112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.504387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.505024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.506613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.511612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.512230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.513009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.513299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.514128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.515764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.518939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 804/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.519838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.527260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 791/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.528913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.534178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b345300-3159-4368-90da-906f60d1245e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.539488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.540149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.540429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.540702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] PATH_INFO: `/v3/projects/104abca264bd460da610c527a5ff6b15/users/5f4abead0b4e4ad9ab6e0bb267e5115e/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.556469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=104abca264bd460da610c527a5ff6b15, user_id=5f4abead0b4e4ad9ab6e0bb267e5115e, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.559190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2f11-6ffe-4698-89c3-23eb46c3c03a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.585901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88eb16-9205-4060-9141-01b6152593b6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.590442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.715163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 792/1596] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:33.716836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.716836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece5c8-80c6-4f42-bd12-7d4a57185bf8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.716836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.716836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.717203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.717203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] PATH_INFO: `/v3/projects/0ec8ad8183374721b596cb447e572de2/users/824fb36b737245b6bc13a8138bcfdb97/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.717203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec8ad8183374721b596cb447e572de2, user_id=824fb36b737245b6bc13a8138bcfdb97, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.717203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.740197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 805/1597] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:33 2022] PUT /identity/v3/projects/104abca264bd460da610c527a5ff6b15/users/5f4abead0b4e4ad9ab6e0bb267e5115e/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:33.741466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.741834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.742110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.762147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:33.764032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:33.797522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 793/1598] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:33 2022] PUT /identity/v3/projects/0ec8ad8183374721b596cb447e572de2/users/824fb36b737245b6bc13a8138bcfdb97/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:33.799056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.820187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:33.849834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 806/1599] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:33.851000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.862633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01f9d-a63a-4dd3-9b95-5b21d7014844 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.884462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8012bfb-51e6-4702-b788-5df26f9a026e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.889880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.895344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.895344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.895344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.895344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.895344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.904222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 794/1600] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.905228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.915734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1379-6373-4cfa-afd8-04fecd444f69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.926780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.927591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.927999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.928419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.929290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.931447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.932539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.933201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.933501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.933774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] PATH_INFO: `/v3/projects/ae7b9a5d2670400a940f37d23d4cf6db/users/ead1ed26a374465c9ac4c7ebe7aa6ca4/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:33.949192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 795/1601] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:33.949192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:33.954624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7b9a5d2670400a940f37d23d4cf6db, user_id=ead1ed26a374465c9ac4c7ebe7aa6ca4, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:33.957348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b56a-1db9-443e-8c4b-02321a8569bd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:33.967231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e806b-6f27-4c8e-bc5b-fe85297e16d1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:33.975112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:33.976293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:33.976798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:33.977291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] PATH_INFO: `/v3/projects/18971fdb85434eb1bcea3759e997c5ed/users/e126e83baeee403f9d8f0ca39a75bb77/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.004478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18971fdb85434eb1bcea3759e997c5ed, user_id=e126e83baeee403f9d8f0ca39a75bb77, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.009965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1dec4-4520-4f03-89eb-b31e680c4869 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.052800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 807/1602] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:33 2022] PUT /identity/v3/projects/ae7b9a5d2670400a940f37d23d4cf6db/users/ead1ed26a374465c9ac4c7ebe7aa6ca4/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:34.054725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.055235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.055508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.076050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:34.080702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.109115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 796/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:33 2022] PUT /identity/v3/projects/18971fdb85434eb1bcea3759e997c5ed/users/e126e83baeee403f9d8f0ca39a75bb77/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:34.109599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.110037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.110320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.121314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:34.141661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] MFA Rules not processed for user `824fb36b737245b6bc13a8138bcfdb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:34.143035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.143683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 808/1604] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:34.144533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.145786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.212372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf432eb-3eb2-43e0-8239-9e1356e2991e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.224115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 797/1605] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:34.224115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.273583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.274546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.275292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.275806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.335339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cdab-46d8-4c1f-be9a-482610955fbc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.344951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.346325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.346438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.346974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.347687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.349347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.352469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:34.365711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 798/1606] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:34.366936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.379328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db0d1-5db3-4f1c-a6bc-e7678b7f76d0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.380508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.384277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886869c-efde-4956-9fc1-85f200899d5b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.386872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.388065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.388325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.388601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] PATH_INFO: `/v3/projects/f5598ad19362433bab0e69154520b28d/users/37e5d858209549e29438900ca20fb2d8/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.397788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 809/1607] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:34.400314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271757c-e567-4aef-972f-4affecab8292 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.400807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271757c-e567-4aef-972f-4affecab8292 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.401282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271757c-e567-4aef-972f-4affecab8292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.406391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5598ad19362433bab0e69154520b28d, user_id=37e5d858209549e29438900ca20fb2d8, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.409093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4075-3e3a-4f00-8eb2-07fe02a497cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.439854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f271757c-e567-4aef-972f-4affecab8292 None None] MFA Rules not processed for user `ead1ed26a374465c9ac4c7ebe7aa6ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:34.441096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f271757c-e567-4aef-972f-4affecab8292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.481269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:34.481994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 799/1608] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:34 2022] PUT /identity/v3/projects/f5598ad19362433bab0e69154520b28d/users/37e5d858209549e29438900ca20fb2d8/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:34.483011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.483353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.483605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.502620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:34.504766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.511780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 810/1609] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:34.512863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271757c-e567-4aef-972f-4affecab8292 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.522107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271757c-e567-4aef-972f-4affecab8292 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.593142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 800/1610] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:34.594314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.608516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7b5e-ee90-4c41-aa37-4d9d095ed5f2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.608754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.609349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.609635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.609882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.615319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.616021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.616204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.616524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.617160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.619113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb8214-af3b-4b36-b018-307ccdcd0940 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.621501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.624103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.636543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 811/1611] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:34.642190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.651898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b539149-05a6-4b20-b933-9ee5069373bc service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.656866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.657530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.658089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.658446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] PATH_INFO: `/v3/projects/6ac9dce37e3641c9b78c746fa8dcd1be/users/37bd85f0c7174b2785b1e7bc2d1f489b/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.675581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac9dce37e3641c9b78c746fa8dcd1be, user_id=37bd85f0c7174b2785b1e7bc2d1f489b, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.678494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b60c02-731e-4577-b66b-924a1d016c4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.758353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 801/1612] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:34.759989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.760362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.760557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.792292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] MFA Rules not processed for user `37e5d858209549e29438900ca20fb2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:34.793531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:34.798342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 812/1613] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:34 2022] PUT /identity/v3/projects/6ac9dce37e3641c9b78c746fa8dcd1be/users/37bd85f0c7174b2785b1e7bc2d1f489b/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:34.799726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d1b1-9a7f-42a2-9124-0fe57dcb06be None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.799958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d1b1-9a7f-42a2-9124-0fe57dcb06be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.800234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d1b1-9a7f-42a2-9124-0fe57dcb06be None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.801666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 813/1614] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 17:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:34.802287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d1b1-9a7f-42a2-9124-0fe57dcb06be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.869455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d1b1-9a7f-42a2-9124-0fe57dcb06be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.873951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.875225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.875225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.875225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.891536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 802/1615] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:34.892654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:34.950059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:34.963836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.965573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710d8d-8cbd-4ec7-b9ec-afb58939d2b2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:34.976352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba9b9-f2d6-4189-9a5a-a4a2d7053378 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:34.979961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 814/1616] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:34.981075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:34.982170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6374-eec1-4bb7-b7a3-26fbb427ea5e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.982463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6374-eec1-4bb7-b7a3-26fbb427ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.982727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:34.982851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6374-eec1-4bb7-b7a3-26fbb427ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.983173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:34.983451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:34.984151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:34.986098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.006179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:35.016596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ecc6374-eec1-4bb7-b7a3-26fbb427ea5e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:35.017982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ecc6374-eec1-4bb7-b7a3-26fbb427ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:35.027844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 815/1617] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:35.030016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.030016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.030304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.070939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 803/1618] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:34 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:35.075103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.078306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:35.079793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:35.086640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce75d-5720-4294-a209-29fef9cd81be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.092295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.093078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.093463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.093834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.095276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.097436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.194486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 816/1619] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 17:44:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:35.195830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.207650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3665-f817-41f8-a6d7-f3907e6f2c84 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.216286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.217628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.217963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.218246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.224636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 804/1620] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:35 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:35.225752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.235829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.240024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.255061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 817/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:35.255915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.277524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeffbc-9810-4acf-8fc9-3884af54676d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.342704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d379-5014-4d7b-a7b5-12f9ab8a1455 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.358990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.359762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.361148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.361518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.362603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.367705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.396038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 805/1622] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:35.396038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.419433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891167d-329e-4483-b800-f7ec24838cb9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.425349 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.426234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.426705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.427194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.427853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.429892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.436918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.437636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.437995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.438357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.505038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 806/1623] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:35 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:35.506490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.539850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7186332-d1d9-4df2-b836-88168a76ef4f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.553052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.553808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.554092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.558249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] PATH_INFO: `/v3/projects/2e62a16fede1491fa022b29a7b225423/users/b4d422cf574648f682837ed70429f3bf/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.574814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.577842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.595332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e62a16fede1491fa022b29a7b225423, user_id=b4d422cf574648f682837ed70429f3bf, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.597033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 818/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:35.598223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.604958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:35.612312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.613600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26d6d5-2fd3-4ed5-9bd6-51d21d6cb961 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.619358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.620243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.620780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.621335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.622182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.624747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.651575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 819/1625] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:35.663461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.695402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac328-67d7-4192-b9e8-32d8207cb5e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.706130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 807/1626] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:35 2022] PUT /identity/v3/projects/2e62a16fede1491fa022b29a7b225423/users/b4d422cf574648f682837ed70429f3bf/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:35.708575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.833891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd239-803b-4cf2-bc2d-aa05da09f93b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.841656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.842444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.842729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.842865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.843109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.843735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.843917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.844358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.845005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] PATH_INFO: `/v3/projects/a4bd89a82ed84b778ca22902d1e40477/users/f133c39e0b8e40bfbd7a811a26e65314/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.845421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.855375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:35.866023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 808/1627] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:35.870842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:35.884213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8da98-4262-4444-b239-7916cad7cf9d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:35.893684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:35.894643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.895783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.896271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] PATH_INFO: `/v3/projects/2e62a16fede1491fa022b29a7b225423/users/b4d422cf574648f682837ed70429f3bf/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:35.898478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bd89a82ed84b778ca22902d1e40477, user_id=f133c39e0b8e40bfbd7a811a26e65314, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.899978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e62a16fede1491fa022b29a7b225423, user_id=b4d422cf574648f682837ed70429f3bf, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:35.901262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8d9d-fdea-49c0-bea1-162f31007502 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.910380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48062719-9ebc-4512-8098-23580693e6ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:35.944757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 809/1628] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:35 2022] PUT /identity/v3/projects/2e62a16fede1491fa022b29a7b225423/users/b4d422cf574648f682837ed70429f3bf/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:44:35.959643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:35.960530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:35.960822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.008697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 820/1629] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:35 2022] PUT /identity/v3/projects/a4bd89a82ed84b778ca22902d1e40477/users/f133c39e0b8e40bfbd7a811a26e65314/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:36.010656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b20c-6be8-4ece-986d-569a76a55b18 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.011144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b20c-6be8-4ece-986d-569a76a55b18 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.011750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b20c-6be8-4ece-986d-569a76a55b18 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.017921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 821/1630] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 17:44:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:36.019309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b20c-6be8-4ece-986d-569a76a55b18 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:36.034899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] MFA Rules not processed for user `b4d422cf574648f682837ed70429f3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:36.038067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:36.133630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b20c-6be8-4ece-986d-569a76a55b18 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:36.141506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:36.142942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.143653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.144887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.145652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:36.148371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903bef-e0d6-4eb8-898d-3abac913aa4a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:36.169394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 822/1631] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:36.169394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c577-9d29-45b2-a80d-17500fa73d70 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.169394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c577-9d29-45b2-a80d-17500fa73d70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.169394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c577-9d29-45b2-a80d-17500fa73d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.178752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 810/1632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:36.179808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:36.192940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527fae-9c2b-409c-b336-e988446e0192 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:36.197503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5344c577-9d29-45b2-a80d-17500fa73d70 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:36.203238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5344c577-9d29-45b2-a80d-17500fa73d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:36.203438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:36.203438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.203438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.203438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] PATH_INFO: `/v3/projects/a4bd89a82ed84b778ca22902d1e40477/users/f133c39e0b8e40bfbd7a811a26e65314/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.205733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bd89a82ed84b778ca22902d1e40477, user_id=f133c39e0b8e40bfbd7a811a26e65314, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:36.210809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:36.230467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 811/1633] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:36 2022] PUT /identity/v3/projects/a4bd89a82ed84b778ca22902d1e40477/users/f133c39e0b8e40bfbd7a811a26e65314/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:36.232022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:36.327248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 823/1634] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:44:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:36.329192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c3d5-c322-4371-858e-79e32408936b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.329192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c3d5-c322-4371-858e-79e32408936b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.329449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c3d5-c322-4371-858e-79e32408936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.339039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:36.376198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a930c3d5-c322-4371-858e-79e32408936b None None] MFA Rules not processed for user `f133c39e0b8e40bfbd7a811a26e65314`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:36.377633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a930c3d5-c322-4371-858e-79e32408936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:36.386015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f391d3-a7bf-4a08-86ad-d951bcce07d7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:36.392788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:36.394509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.394954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.395589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.480604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 824/1635] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:36.485189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930c3d5-c322-4371-858e-79e32408936b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:36.499771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:36.502694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:36.509619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930c3d5-c322-4371-858e-79e32408936b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:36.524931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 812/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:36.542883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:36.544176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.549789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.549789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.657004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:36.660419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:36.674067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 825/1637] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:36.708424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:36.719721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d850e6-5c5f-4020-95fc-e6128ef23270 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:36.725496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:36.726276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:36.727576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:36.727576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:36.737358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:36.740624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:36.742451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e212-2071-4eb5-9a5d-a0c1752e9f1b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:36.754844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 813/1638] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:37.819483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:37.819483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886c92c-36d6-454f-8c8b-18ad94a28c95 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:37.819483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:37.819483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] PATH_INFO: `/v3/users/37e5d858209549e29438900ca20fb2d8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e5d858209549e29438900ca20fb2d8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: warnings.warn(msg) Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: Aug 24 17:44:37.821155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:37.847451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:38.348190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e5d858209549e29438900ca20fb2d8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:38.352117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e5d858209549e29438900ca20fb2d8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:38.354921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e5d858209549e29438900ca20fb2d8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:38.378952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e5d858209549e29438900ca20fb2d8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:38.459863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e5d858209549e29438900ca20fb2d8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:38.556689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 826/1639] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:37 2022] DELETE /identity/v3/users/37e5d858209549e29438900ca20fb2d8 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:38.562048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5333b8-b61d-4b52-bc10-32ddb7ff300b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:38.562583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5333b8-b61d-4b52-bc10-32ddb7ff300b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:38.562583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5333b8-b61d-4b52-bc10-32ddb7ff300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:38.613238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5e5333b8-b61d-4b52-bc10-32ddb7ff300b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:38.614485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e5333b8-b61d-4b52-bc10-32ddb7ff300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:38.772792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 814/1640] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:38.898994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:38.901152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:38.910387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b835-cd3b-44f0-9a0f-1863317ff70b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:38.911570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b835-cd3b-44f0-9a0f-1863317ff70b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:38.912023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b835-cd3b-44f0-9a0f-1863317ff70b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:38.913618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 815/1641] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 17:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:38.923580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0460-385b-4143-9d5a-a64750a9d690 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:38.924259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0460-385b-4143-9d5a-a64750a9d690 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:38.924850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0460-385b-4143-9d5a-a64750a9d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:38.971130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bddb0460-385b-4143-9d5a-a64750a9d690 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:38.971130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bddb0460-385b-4143-9d5a-a64750a9d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:39.052500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 816/1642] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 17:44:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:39.058926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a2f3-4a4a-4eac-9b3e-a19ec0a2d62a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:39.058926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a2f3-4a4a-4eac-9b3e-a19ec0a2d62a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:39.058926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a2f3-4a4a-4eac-9b3e-a19ec0a2d62a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:39.067940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 817/1643] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 17:44:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:39.069478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:39.069766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:39.070048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:39.078367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc937-88a3-42a3-b6ad-a3f087054ffc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:39.087464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:39.090829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:39.093568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:39.093568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:39.102540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:39.103863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:39.117653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 818/1644] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:39.117998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:39.119895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:39.138628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:39.140269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:39.143690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 827/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:39.211183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2e09b-2d12-48eb-8428-d5f031fa5cca None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:39.216217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:39.216861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:39.217402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:39.217668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:39.232303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:39.232303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:39.246013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 819/1646] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:44:40.900197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:40.902150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:40.928945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87000d95-2b59-4045-b1f4-c8f025d29b89 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:40.944705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:40.945448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:40.945977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:40.946417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] PATH_INFO: `/v3/projects/f5598ad19362433bab0e69154520b28d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:40.948809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5598ad19362433bab0e69154520b28d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:40.952619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:41.183682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5598ad19362433bab0e69154520b28d', 'request_id': 'req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.192492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5598ad19362433bab0e69154520b28d', 'request_id': 'req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.294165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5598ad19362433bab0e69154520b28d', 'request_id': 'req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.336376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] The token cache is being invalidate because project f5598ad19362433bab0e69154520b28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:41.336936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.337843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.348379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 828/1647] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:40 2022] DELETE /identity/v3/projects/f5598ad19362433bab0e69154520b28d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:41.350935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:41.376402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831a02-c263-4119-97a3-55ecbd9b2632 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:41.436519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:41.560170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:41.561218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:41.561743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:41.562168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] PATH_INFO: `/v3/users/f133c39e0b8e40bfbd7a811a26e65314` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:41.566927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f133c39e0b8e40bfbd7a811a26e65314)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:41.569420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:41.773631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:41.775172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:41.804780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b0672-83ba-4cfc-b9fb-bbd7ee7bf1ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:41.821710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:41.822572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:41.823017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:41.823464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] PATH_INFO: `/v3/users/824fb36b737245b6bc13a8138bcfdb97` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:41.827893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824fb36b737245b6bc13a8138bcfdb97)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:41.839430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:41.876736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f133c39e0b8e40bfbd7a811a26e65314'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.889750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f133c39e0b8e40bfbd7a811a26e65314'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.889750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f133c39e0b8e40bfbd7a811a26e65314'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.890102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:41.899747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f133c39e0b8e40bfbd7a811a26e65314'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:41.991623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d1812c20-616b-413f-83cc-5b07927f269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f133c39e0b8e40bfbd7a811a26e65314'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.034689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 820/1648] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:41 2022] DELETE /identity/v3/users/f133c39e0b8e40bfbd7a811a26e65314 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:42.100326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824fb36b737245b6bc13a8138bcfdb97'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.101636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824fb36b737245b6bc13a8138bcfdb97'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.102414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824fb36b737245b6bc13a8138bcfdb97'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.133346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824fb36b737245b6bc13a8138bcfdb97'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.156627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824fb36b737245b6bc13a8138bcfdb97'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.248478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 829/1649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:41 2022] DELETE /identity/v3/users/824fb36b737245b6bc13a8138bcfdb97 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:44:42.252897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:42.253397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:42.253852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:42.300562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:42.302585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:42.383583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:42.385360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:42.478027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 821/1650] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:42.532258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:42.533724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:42.559627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41fdd-c0d0-4017-a9a8-ba3d286769f7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:42.590312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:42.591311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:42.591767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:42.592260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] PATH_INFO: `/v3/users/ead1ed26a374465c9ac4c7ebe7aa6ca4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:42.599122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead1ed26a374465c9ac4c7ebe7aa6ca4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:42.601674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:42.672708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:42.708577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd52afd-ca38-415f-a72a-996cce3b1af4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:42.714110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:42.714771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:42.715052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:42.715449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:42.734215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:42.736135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ccbb8-335a-4478-95ac-70af0883cec3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:42.765931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 822/1651] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:42.869987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead1ed26a374465c9ac4c7ebe7aa6ca4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.872840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead1ed26a374465c9ac4c7ebe7aa6ca4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.874006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead1ed26a374465c9ac4c7ebe7aa6ca4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.890857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead1ed26a374465c9ac4c7ebe7aa6ca4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:42.922034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead1ed26a374465c9ac4c7ebe7aa6ca4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:43.003007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 830/1652] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:42 2022] DELETE /identity/v3/users/ead1ed26a374465c9ac4c7ebe7aa6ca4 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:43.008036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:43.008649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:43.009145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:43.054273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:43.058661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:43.221216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 823/1653] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:43.276796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:43.280534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:43.299628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:43.440953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc93b79-fdc1-408d-9fb5-cb7252d200a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:43.458408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:43.459052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:43.459419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:43.459723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:43.475264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:43.480246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:43.506876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 831/1654] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:44.111273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:44.114118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:44.131803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d3f0-c96a-4e43-949b-a4c7ba29f678 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:44.141213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:44.147939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:44.148546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:44.150602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] PATH_INFO: `/v3/projects/0ec8ad8183374721b596cb447e572de2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:44.153756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec8ad8183374721b596cb447e572de2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:44.156183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:44:44.156183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: warnings.warn(msg) Aug 24 17:44:44.156183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: Aug 24 17:44:44.159305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:44.482062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:44.483696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:44.522563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bdf0-62d4-4a57-8da5-c8d16805f7b8 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:44.564325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec8ad8183374721b596cb447e572de2', 'request_id': 'req-3055f302-dbf2-4536-ad51-a11ce0d2d49c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:44.601721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec8ad8183374721b596cb447e572de2', 'request_id': 'req-3055f302-dbf2-4536-ad51-a11ce0d2d49c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:44.677941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec8ad8183374721b596cb447e572de2', 'request_id': 'req-3055f302-dbf2-4536-ad51-a11ce0d2d49c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:44.778502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:44.779701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] The token cache is being invalidate because project 0ec8ad8183374721b596cb447e572de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:44.781017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:44.781940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:44.782393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:44.782513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:44.786281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 824/1655] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:44 2022] DELETE /identity/v3/projects/0ec8ad8183374721b596cb447e572de2 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:44.789494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] PATH_INFO: `/v3/projects/a4bd89a82ed84b778ca22902d1e40477` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:44.790671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:44.796322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:44.796752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bd89a82ed84b778ca22902d1e40477)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:44.813358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:44.834905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f302-dbf2-4536-ad51-a11ce0d2d49c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:44.850857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:44.851565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:44.851923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:44.852133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] PATH_INFO: `/v3/users/b4d422cf574648f682837ed70429f3bf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:44.854526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d422cf574648f682837ed70429f3bf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:44.859734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:45.098587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d422cf574648f682837ed70429f3bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.100633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d422cf574648f682837ed70429f3bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.101772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d422cf574648f682837ed70429f3bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.125699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bd89a82ed84b778ca22902d1e40477', 'request_id': 'req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.133015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d422cf574648f682837ed70429f3bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.147623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bd89a82ed84b778ca22902d1e40477', 'request_id': 'req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.207459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b22c55b-1f41-42a6-8503-6cd581dd1cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d422cf574648f682837ed70429f3bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.210577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:45.264276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 825/1656] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:44 2022] DELETE /identity/v3/users/b4d422cf574648f682837ed70429f3bf => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:45.288551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bd89a82ed84b778ca22902d1e40477', 'request_id': 'req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.376558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] The token cache is being invalidate because project a4bd89a82ed84b778ca22902d1e40477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:45.379007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.391650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:45.405063 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 832/1657] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:44 2022] DELETE /identity/v3/projects/a4bd89a82ed84b778ca22902d1e40477 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:44:45.410248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5221b-2422-4645-985a-87ef1df224be None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:45.410722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5221b-2422-4645-985a-87ef1df224be None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:45.411154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5221b-2422-4645-985a-87ef1df224be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:45.452054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b7a5221b-2422-4645-985a-87ef1df224be None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:45.456319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7a5221b-2422-4645-985a-87ef1df224be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:45.579778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:45.591354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:45.634140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 826/1658] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:45.644018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:45.644317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:45.644607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:45.691921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:45.701662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:45.703587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:45.722264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd23fe-545a-4eb3-9f09-3aefed4c5d64 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:45.727570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 827/1659] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:45.728658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:45.741609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:45.742559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:45.742981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:45.743560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] PATH_INFO: `/v3/projects/ae7b9a5d2670400a940f37d23d4cf6db` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:45.748946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666ea1b-4861-446a-8240-9e0ba8213b5d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:45.755369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:45.756459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:45.756664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7b9a5d2670400a940f37d23d4cf6db)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:45.762026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:45.762026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:45.762026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:45.762026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:45.762026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:45.762601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:45.778564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 828/1660] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:45.781924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:45.802733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b0d7-af9d-49c8-a0bd-723843bb164e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:45.826321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:45.826997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:45.827489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:45.827779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:45.828570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:45.833770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:45.995274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 829/1661] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:45 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:44:45.998292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.002090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7b9a5d2670400a940f37d23d4cf6db', 'request_id': 'req-49e048b6-b988-4397-a9f5-64db8a5a8d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:46.022350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7b9a5d2670400a940f37d23d4cf6db', 'request_id': 'req-49e048b6-b988-4397-a9f5-64db8a5a8d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:46.100477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7b9a5d2670400a940f37d23d4cf6db', 'request_id': 'req-49e048b6-b988-4397-a9f5-64db8a5a8d64'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:46.136645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] The token cache is being invalidate because project ae7b9a5d2670400a940f37d23d4cf6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:46.137701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:46.138470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e048b6-b988-4397-a9f5-64db8a5a8d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:46.140603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 833/1662] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:45 2022] DELETE /identity/v3/projects/ae7b9a5d2670400a940f37d23d4cf6db => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:46.147934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbae7-8f98-4947-af78-67e3caef92f0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.148108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbae7-8f98-4947-af78-67e3caef92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.148366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbae7-8f98-4947-af78-67e3caef92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.170063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083358c8-5e17-42a7-ae2c-1dd541a9b593 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.183497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.184916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.185388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.185667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.186309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.190854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.198504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e9fbae7-8f98-4947-af78-67e3caef92f0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:46.199936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e9fbae7-8f98-4947-af78-67e3caef92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:46.232132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 834/1663] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:46.241237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.241442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.241710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.288361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:46.289633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:46.307490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 830/1664] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:45 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:46.310057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 835/1665] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:46.313500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.315831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.324149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:46.346871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcfbd-13b2-421c-bedd-537eb7e0ddf5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.362441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.363069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.363381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.363661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.364327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:46.364649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.365958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce5c36-8997-46cc-9ab8-848f51e4e87d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.366294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.373599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.374597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.376550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.377402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.379997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.382518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.393247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 836/1666] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:46.398493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.414062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 831/1667] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:46.417719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.422098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14088-b7f7-41f5-8fd7-94ff51157ee5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.435109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.435751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.436038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.436326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.436975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.443579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.445792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce12da-d23b-41db-953b-585b85dc2e41 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.457983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.459651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.460087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.460506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.461531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.463482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.481810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 832/1668] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:44:46.483744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.499173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214b40-9f54-40d4-bef6-f65f3554519c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.518318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.519025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.519343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.519625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] PATH_INFO: `/v3/projects/3c5a40e394ef4dbe94051ca0591560c1/users/0c2f262e3ea5429eb3782a9f8574acc3/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.538216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:46.559476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5a40e394ef4dbe94051ca0591560c1, user_id=0c2f262e3ea5429eb3782a9f8574acc3, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.563677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d464-b355-4b50-844c-c412119f2b19 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.607338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 837/1669] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:44:46.611916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.672852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 833/1670] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:46 2022] PUT /identity/v3/projects/3c5a40e394ef4dbe94051ca0591560c1/users/0c2f262e3ea5429eb3782a9f8574acc3/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:46.691479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.692171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.692635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.764802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] MFA Rules not processed for user `0c2f262e3ea5429eb3782a9f8574acc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:46.769277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:46.803703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece377-0241-4991-98be-38fc78d1a676 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.929914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.930920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.931517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:46.932336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:46.933195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:46.936944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:46.961776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 834/1671] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:46.967068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:46.989008 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338207-cf7a-4bea-8d97-a6d1aaef7b20 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:46.997206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:46.998918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:46.999339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.003422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.004895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.007506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.034146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 838/1672] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/users => generated 282 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:47.037946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.055553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447511-092d-47ec-974e-c0f19815862f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:47.067695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:47.071414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.071414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.071414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.071414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.074826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.095176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 839/1673] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:44:47.102916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.116981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070c18-a892-4f93-949e-ce962fe0a61d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:47.135433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 835/1674] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:46 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:44:47.136689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.140658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:47.143699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:47.144121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.146138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.146694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.147652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.152298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.188843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 840/1675] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:47.190971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.214393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:47.218411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b670ca8-ba65-4650-903f-4dff84843387 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:47.308086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88d1c-1f35-4084-8e28-f577c806305f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:47.324433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:47.325719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.326164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.326721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] PATH_INFO: `/v3/projects/2e62a16fede1491fa022b29a7b225423` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.328214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e62a16fede1491fa022b29a7b225423)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.332163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.356323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:47.357472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.357837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.358185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.358911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.361752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.494674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 841/1676] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:47 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:47.498812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.555372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c36d-3818-4436-bcd5-bd16be1a2e0f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:47.564498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e62a16fede1491fa022b29a7b225423', 'request_id': 'req-382c6984-70b5-44e4-8d2a-6069e014d026'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:47.581589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:47.588320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e62a16fede1491fa022b29a7b225423', 'request_id': 'req-382c6984-70b5-44e4-8d2a-6069e014d026'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:47.613848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e62a16fede1491fa022b29a7b225423', 'request_id': 'req-382c6984-70b5-44e4-8d2a-6069e014d026'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:47.718629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] The token cache is being invalidate because project 2e62a16fede1491fa022b29a7b225423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:47.719137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:47.720135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-382c6984-70b5-44e4-8d2a-6069e014d026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:47.725201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 836/1677] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:47 2022] DELETE /identity/v3/projects/2e62a16fede1491fa022b29a7b225423 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:47.730412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739519-d8ed-4ab8-aefe-42b8b3acc1b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.731649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739519-d8ed-4ab8-aefe-42b8b3acc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.734666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739519-d8ed-4ab8-aefe-42b8b3acc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.758759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:47.760906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.762727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.766977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] PATH_INFO: `/v3/projects/4d47f9a3ad6e48c59896bb566b8a5ff8/users/39cf693e2681483fac1ae9c1327339c5/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:47.804409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d47f9a3ad6e48c59896bb566b8a5ff8, user_id=39cf693e2681483fac1ae9c1327339c5, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:47.808121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:47.816200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-56739519-d8ed-4ab8-aefe-42b8b3acc1b2 None None] MFA Rules not processed for user `5153ddc5d5e4480a81e636fba58821d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:47.817606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56739519-d8ed-4ab8-aefe-42b8b3acc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:47.901286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 842/1678] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:47 2022] PUT /identity/v3/projects/4d47f9a3ad6e48c59896bb566b8a5ff8/users/39cf693e2681483fac1ae9c1327339c5/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:47.916077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:47.921180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:47.966934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 837/1679] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:47.972314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:47.972314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:47.972314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.026024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:48.029102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:48.108463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bff9-9ede-454b-9463-cad6b847310b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.116585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:48.118862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.127039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.127505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.127793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.129095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.131457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63df3-ce12-4802-858d-f9b2c36e6ad1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.155305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 843/1680] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:48.157385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0298-8eb2-4f81-953d-b30b5a2773e2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.157762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0298-8eb2-4f81-953d-b30b5a2773e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.158774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0298-8eb2-4f81-953d-b30b5a2773e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.187312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 838/1681] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:48.187312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.187312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:48.237716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2baf0298-8eb2-4f81-953d-b30b5a2773e2 None None] MFA Rules not processed for user `39cf693e2681483fac1ae9c1327339c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:48.240211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2baf0298-8eb2-4f81-953d-b30b5a2773e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:48.274680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99692-4ebc-4093-95a2-6e1339d17d51 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.282066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.282701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.283038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.283286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.352706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.354726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.366580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 839/1682] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:48.367799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.379913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5d8-c7fa-413c-8d67-54ab0cee35e6 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.399290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.399970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.399970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.400305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] PATH_INFO: `/v3/projects/3ac4314f17f144e1a12e95a21a55b970/users/acbc3cc83c8d453792c35167918b5be5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.420286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 844/1683] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:48.421377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.421764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.422140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.439302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac4314f17f144e1a12e95a21a55b970, user_id=acbc3cc83c8d453792c35167918b5be5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.443715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.473977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:48.475604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:48.494803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 845/1684] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:48.495926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.501786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:48.526650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c622b7-e62d-4cf2-94fd-dbca40c91bb3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.542798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.544167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.544559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.544933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.545931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.548786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.620656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 840/1685] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:48 2022] PUT /identity/v3/projects/3ac4314f17f144e1a12e95a21a55b970/users/acbc3cc83c8d453792c35167918b5be5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:48.626812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.682087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 846/1686] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:48 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:48.683548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.698938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:48.821412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae0a5-5b41-44c4-bc56-510695d752aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.834841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.835916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.836306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.836727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.837504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:48.837949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.839142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ed9a-5339-4f12-b08e-e65459673289 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.840076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.854073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.854969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.854969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.857259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.859675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.868483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.876308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 841/1687] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:48.877445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.897516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff48b-819a-45eb-a631-40c335fec644 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.904568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 847/1688] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:48.905655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:48.933425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.933805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.934151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.934441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.935313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.937202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:48.950744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:48.963964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0ef2-0130-4d46-8bf2-095a02bd9fb9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:48.979198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:48.980104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:48.981728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:48.982023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:48.985158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:48.990568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.095450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 842/1689] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:48 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:49.099384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.118251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903c4c-272f-474a-bf4d-5293110f56a1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.125246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.127032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.127032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.127032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] PATH_INFO: `/v3/projects/3ac4314f17f144e1a12e95a21a55b970/users/acbc3cc83c8d453792c35167918b5be5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.130095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac4314f17f144e1a12e95a21a55b970, user_id=acbc3cc83c8d453792c35167918b5be5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:49.133946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc68364-8589-485b-8784-76933e5552d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.160893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 848/1691] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:48 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:49.161829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.170151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 843/1691] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:49 2022] PUT /identity/v3/projects/3ac4314f17f144e1a12e95a21a55b970/users/acbc3cc83c8d453792c35167918b5be5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:49.172200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.172491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.172829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.284748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] MFA Rules not processed for user `acbc3cc83c8d453792c35167918b5be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:49.290123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:49.340564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5120-609d-420d-ba94-28b18a05e5b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.360241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.361285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.361588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.361870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.362950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:49.364211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.393330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 849/1692] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:49.393330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.419183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defeae-cc03-480b-9bbe-1979117430fc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.433098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.434730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.435023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.435339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.435993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:49.445683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.507985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 844/1693] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:49.510851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.536171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5cdb3-f775-4eb2-8704-ba5b24a046fa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.565821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.566571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.566855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.567151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] PATH_INFO: `/v3/projects/dc43369daa9d4ccfa51f20d950acfac6/users/dc95df3b90c04d43ba71f44f580d59ce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.609954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 850/1694] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:49 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:49.614152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.619851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:49.640280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc43369daa9d4ccfa51f20d950acfac6, user_id=dc95df3b90c04d43ba71f44f580d59ce, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:49.647970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.755970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 845/1695] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:49 2022] PUT /identity/v3/projects/dc43369daa9d4ccfa51f20d950acfac6/users/dc95df3b90c04d43ba71f44f580d59ce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:49.755970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.832991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305fa0-1fb0-43be-9f06-b98e9a00bd77 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.848287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:49.923935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d4d20-62eb-4775-b677-57c8d31bfa8f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:49.938342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.939048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.939356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.939634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.940919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:49.942584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:49.962162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:49.963786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:49.964296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:49.965656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:49.973491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 846/1696] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:49.974468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:49.994496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95bc2f-1474-4dd9-b27c-4cdfdf827fad admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.006994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.007708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.008004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.008247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.009059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.013028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.028307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:50.037404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 847/1697] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:50.038451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:50.062176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d21d5-b44d-43c8-b813-323529f0dea1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.076711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.078777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.078777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.078777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.078777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.085373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.110148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 848/1698] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:50.111036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.112589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.119753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:50.142996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 851/1699] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:50.145745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:50.145859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdec69-2d1c-4ce7-8971-45681e6ac0a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.156287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.156975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.157257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.157538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] PATH_INFO: `/v3/projects/dc43369daa9d4ccfa51f20d950acfac6/users/dc95df3b90c04d43ba71f44f580d59ce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.160825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc43369daa9d4ccfa51f20d950acfac6, user_id=dc95df3b90c04d43ba71f44f580d59ce, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.162024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3325-0aa9-4e86-9a7d-16c75f985892 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.163583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5115-f4bd-48b8-84f7-5660693fc5ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.168974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.169916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.171672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.172193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] PATH_INFO: `/v3/projects/517d1c2461dc4ce6a54d5b204c83ab13/users/107aff39b2a94f6a85ffddbe19a029fc/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.191156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 849/1700] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:50 2022] PUT /identity/v3/projects/dc43369daa9d4ccfa51f20d950acfac6/users/dc95df3b90c04d43ba71f44f580d59ce/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:50.203211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.203510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.203787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.225212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517d1c2461dc4ce6a54d5b204c83ab13, user_id=107aff39b2a94f6a85ffddbe19a029fc, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.238069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d293415-a56d-4a25-85a3-607a1169c656 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.260922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] MFA Rules not processed for user `dc95df3b90c04d43ba71f44f580d59ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:50.262510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:50.414801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 852/1701] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:50 2022] PUT /identity/v3/projects/517d1c2461dc4ce6a54d5b204c83ab13/users/107aff39b2a94f6a85ffddbe19a029fc/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:50.429963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.430258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.430540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.518024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] MFA Rules not processed for user `107aff39b2a94f6a85ffddbe19a029fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:50.520500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 850/1702] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:44:50.522308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:50.527270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:50.607886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3acc7d-e30a-4361-bbef-9a87e07fc9dd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.682185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:50.704066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.705066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.705733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.706448 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.758166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 853/1703] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:50.760328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:50.867361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.869577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:50.899735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63732-de71-43b1-a99b-bb23fdea8487 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:50.902992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 851/1704] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:50.911991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:50.912651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:50.920011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:50.920914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:50.921709 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:50.923755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.071907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 854/1705] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:50 2022] POST /identity/v3/projects => generated 381 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:51.077133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.098697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859601-4b62-4fff-bf9f-aa9a5930bb0e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.274884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:51.275609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:51.275887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:51.280669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:51.280669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:51.280669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.453060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 852/1706] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:44:51 2022] POST /identity/v3/users => generated 297 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:51.456529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.470417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4b93-ca55-4ffb-9816-16cd5df1e5b4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.489131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:51.489908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:51.490346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:51.490786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:51.491593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:51.493249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.516392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 855/1707] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:51.520807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.534150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96a56-0ea2-4f38-a872-7d573f6ff87b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.542114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:51.543386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:51.543817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:51.544335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] PATH_INFO: `/v3/projects/25f52b8f73804649823d77b56859e471/users/3e2ad0a3aee142288a140c552ebac66a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:51.593980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f52b8f73804649823d77b56859e471, user_id=3e2ad0a3aee142288a140c552ebac66a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:51.603224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.693682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 853/1708] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:51 2022] PUT /identity/v3/projects/25f52b8f73804649823d77b56859e471/users/3e2ad0a3aee142288a140c552ebac66a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:51.697945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.714173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9673-9494-4971-8976-c6dfd5aed860 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.720467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:51.803210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:51.807613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.850743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:51.852022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:51.852468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:51.852881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:51.853702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:51.858876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.882338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 856/1709] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:44:51.886376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:51.914142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f8422-5c23-4f7c-b062-dcf71c09bdb4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.924250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:51.925724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:51.927295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:51.927744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] PATH_INFO: `/v3/projects/25f52b8f73804649823d77b56859e471/users/3e2ad0a3aee142288a140c552ebac66a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:51.936428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f52b8f73804649823d77b56859e471, user_id=3e2ad0a3aee142288a140c552ebac66a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:51.955020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e29ee-83ba-4477-b91c-d27337d07cf7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:51.969260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a27-9437-4e3c-9039-450547495c05 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:51.990495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 857/1710] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:44:51 2022] PUT /identity/v3/projects/25f52b8f73804649823d77b56859e471/users/3e2ad0a3aee142288a140c552ebac66a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:52.005127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:52.007004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:52.008027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:52.103575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] MFA Rules not processed for user `3e2ad0a3aee142288a140c552ebac66a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:52.108221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:52.236850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:52.237636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:52.237799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:52.238078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] PATH_INFO: `/v3/users/0c2f262e3ea5429eb3782a9f8574acc3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:52.256253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2f262e3ea5429eb3782a9f8574acc3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:52.257822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:52.282274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 858/1711] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:52.287428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:52.415422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665205-5a84-4fda-a608-0768eaa55213 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:52.421629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:52.422281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:52.422732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:52.423044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:52.446716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:52.448578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497341-0367-4a3b-a042-f50e1afadbc1 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:52.464359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 859/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:52.467170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:52.467720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:52.468101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:52.517295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] MFA Rules not processed for user `924185a6e69b4e9aa8bcc456c096015e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:52.518674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:52.650363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2f262e3ea5429eb3782a9f8574acc3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:52.651124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2f262e3ea5429eb3782a9f8574acc3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:52.651749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2f262e3ea5429eb3782a9f8574acc3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:52.684217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2f262e3ea5429eb3782a9f8574acc3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:52.688921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:52.790951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2f262e3ea5429eb3782a9f8574acc3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:52.802740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 860/1713] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:52.809311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:52.813073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:52.821178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:52.845670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 854/1714] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:51 2022] DELETE /identity/v3/users/0c2f262e3ea5429eb3782a9f8574acc3 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:44:52.845670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:52.848011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:52.868315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba05e7-ee9f-4d1c-88dd-49054a6c0e05 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:53.075648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:53.076488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:53.082561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:53.082561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] PATH_INFO: `/v3/users/39cf693e2681483fac1ae9c1327339c5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:53.082561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cf693e2681483fac1ae9c1327339c5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:53.082561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:53.111307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b743a-b43f-4d96-8814-48b0622d4e88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:53.125496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:53.126236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:53.126524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:53.126809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:53.312538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:53.317808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5ea7c-9c3e-432b-9afb-940d4cfb5635 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:53.346774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 855/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:53.348967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f691-2066-491e-b186-63276b81c98d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:53.349265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f691-2066-491e-b186-63276b81c98d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:53.349551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f691-2066-491e-b186-63276b81c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:53.396992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cf693e2681483fac1ae9c1327339c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:53.401019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cf693e2681483fac1ae9c1327339c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:53.404085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cf693e2681483fac1ae9c1327339c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:53.410231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c946f691-2066-491e-b186-63276b81c98d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:53.413515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c946f691-2066-491e-b186-63276b81c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:53.429300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cf693e2681483fac1ae9c1327339c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:53.441071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 856/1716] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:53.500889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cd922b30-9acf-4c88-a5c6-631015045084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cf693e2681483fac1ae9c1327339c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:53.514166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f691-2066-491e-b186-63276b81c98d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:53.515735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c946f691-2066-491e-b186-63276b81c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:53.646237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f691-2066-491e-b186-63276b81c98d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:53.656783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:53.659754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:53.660108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:53.660533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:53.702435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 861/1717] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:52 2022] DELETE /identity/v3/users/39cf693e2681483fac1ae9c1327339c5 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:53.712672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:53.715555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:53.716555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:53.716848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:53.718237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:53.741951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 857/1718] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:53.787215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:53.787215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:53.865914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:53.939930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 862/1719] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:53.971683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:53.973811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:53.993178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b63b-024f-44a9-965e-d3b0112ffb14 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:54.110279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:54.111199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:54.111616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:54.112058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:54.161165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:54.162823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:54.176185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 858/1720] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:54.219598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:54.221348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:54.377550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7c9d-5152-4664-9cf7-f0b88b8540c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:54.396480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2ad0a3aee142288a140c552ebac66a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f52b8f73804649823d77b56859e471', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:54.397129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:54.397680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:54.397680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:54.398332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:54.398629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:54.401077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:54.433211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 863/1721] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:54.439339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:54.506139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9e44-a13d-4948-b4d9-23a2f2f51723 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:54.520131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2ad0a3aee142288a140c552ebac66a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f52b8f73804649823d77b56859e471', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:54.584703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:54.584703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:54.584703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:54.584703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:54.584703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:54.934084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 859/1722] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:54 2022] POST /identity/v3/projects => generated 354 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:44:54.936294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:54.952987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482396-113c-4dc4-970b-43f98b939d67 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:55.060413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:55.143123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2ad0a3aee142288a140c552ebac66a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f52b8f73804649823d77b56859e471', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:55.143876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:55.144341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:55.144967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:55.145712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:55.146070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:55.147736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:55.191075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 864/1723] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:55.274648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:55.298225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5dab8-a7ea-4c2c-97ad-ab443ed51c33 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:55.318317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2ad0a3aee142288a140c552ebac66a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f52b8f73804649823d77b56859e471', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:55.321913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:55.322492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:55.323309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] PATH_INFO: `/v3/projects/44e73e8ca778480aad68baf151337557` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:55.325618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44e73e8ca778480aad68baf151337557)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:55.336364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:55.569345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e73e8ca778480aad68baf151337557', 'request_id': 'req-3297a534-8631-4e3e-a976-a5654e145904'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:55.599952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e73e8ca778480aad68baf151337557', 'request_id': 'req-3297a534-8631-4e3e-a976-a5654e145904'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:55.610152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e73e8ca778480aad68baf151337557', 'request_id': 'req-3297a534-8631-4e3e-a976-a5654e145904'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:55.722991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] The token cache is being invalidate because project 44e73e8ca778480aad68baf151337557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:55.723300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:55.727682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:55.733774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 860/1724] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:55 2022] DELETE /identity/v3/projects/44e73e8ca778480aad68baf151337557 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:55.895895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:55.898398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.072537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781aa9-e3c4-4d83-b6fe-b3c263402c1c tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:56.079023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:56.151921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:56.153176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.164548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:56.166876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.167411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.167751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] PATH_INFO: `/v3/projects/3c5a40e394ef4dbe94051ca0591560c1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.172644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5a40e394ef4dbe94051ca0591560c1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:56.178833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:56.179464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a534-8631-4e3e-a976-a5654e145904 tempest-VolumeQuotaClassesTest-1996174605 tempest-VolumeQuotaClassesTest-1996174605-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:56.195252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:56.196304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.196592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.196869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] PATH_INFO: `/v3/projects/4d47f9a3ad6e48c59896bb566b8a5ff8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.198342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d47f9a3ad6e48c59896bb566b8a5ff8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:56.201418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:56.375017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5a40e394ef4dbe94051ca0591560c1', 'request_id': 'req-31ca8737-46d0-430b-a11c-4e50264ed5fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.398568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5a40e394ef4dbe94051ca0591560c1', 'request_id': 'req-31ca8737-46d0-430b-a11c-4e50264ed5fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.405620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d47f9a3ad6e48c59896bb566b8a5ff8', 'request_id': 'req-f01b16a9-a37c-4960-a1bc-141651257ab1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.412336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d47f9a3ad6e48c59896bb566b8a5ff8', 'request_id': 'req-f01b16a9-a37c-4960-a1bc-141651257ab1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.419483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d47f9a3ad6e48c59896bb566b8a5ff8', 'request_id': 'req-f01b16a9-a37c-4960-a1bc-141651257ab1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.520937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5a40e394ef4dbe94051ca0591560c1', 'request_id': 'req-31ca8737-46d0-430b-a11c-4e50264ed5fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.538401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] The token cache is being invalidate because project 3c5a40e394ef4dbe94051ca0591560c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:56.541630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.543876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31ca8737-46d0-430b-a11c-4e50264ed5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.547206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 865/1725] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:55 2022] DELETE /identity/v3/projects/3c5a40e394ef4dbe94051ca0591560c1 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:56.553116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab11f-9852-46b5-a2da-425e86b0897c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.553850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab11f-9852-46b5-a2da-425e86b0897c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.554291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab11f-9852-46b5-a2da-425e86b0897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.596794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cc1ab11f-9852-46b5-a2da-425e86b0897c None None] MFA Rules not processed for user `e126e83baeee403f9d8f0ca39a75bb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:56.598398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc1ab11f-9852-46b5-a2da-425e86b0897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.648380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] The token cache is being invalidate because project 4d47f9a3ad6e48c59896bb566b8a5ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:56.648380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.649849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f01b16a9-a37c-4960-a1bc-141651257ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:56.653732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 861/1726] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:56 2022] DELETE /identity/v3/projects/4d47f9a3ad6e48c59896bb566b8a5ff8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:56.655281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.656276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.659499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.701986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:56.706149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] MFA Rules not processed for user `5f4abead0b4e4ad9ab6e0bb267e5115e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:56.715497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.740129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 866/1727] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:56.740129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.740129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.740129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.797676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] MFA Rules not processed for user `37bd85f0c7174b2785b1e7bc2d1f489b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:56.799852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.811493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:56.813976 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 862/1728] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:56.815729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:56.817303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:56.962221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9af42-58d2-4c8d-9707-3030b8668ea9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:56.973248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:56.974558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:56.975614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:56.975614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] PATH_INFO: `/v3/users/acbc3cc83c8d453792c35167918b5be5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:56.976576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbc3cc83c8d453792c35167918b5be5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:56.976688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 867/1729] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:56.977757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:56.978783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:56.979249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:57.017216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aabd50-2d3a-4459-807a-a154a6e98e63 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:57.023104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:57.023936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:57.024560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:57.026363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] PATH_INFO: `/v3/users/dc95df3b90c04d43ba71f44f580d59ce` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:57.032083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc95df3b90c04d43ba71f44f580d59ce)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:57.043433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:57.262568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbc3cc83c8d453792c35167918b5be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.263578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbc3cc83c8d453792c35167918b5be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.264257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbc3cc83c8d453792c35167918b5be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.291364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbc3cc83c8d453792c35167918b5be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.344737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc95df3b90c04d43ba71f44f580d59ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.345905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc95df3b90c04d43ba71f44f580d59ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.348723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc95df3b90c04d43ba71f44f580d59ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.373112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc95df3b90c04d43ba71f44f580d59ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.396711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc95df3b90c04d43ba71f44f580d59ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.411797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbc3cc83c8d453792c35167918b5be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:57.458195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 863/1730] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:56 2022] DELETE /identity/v3/users/acbc3cc83c8d453792c35167918b5be5 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:57.459136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:57.460870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:57.528435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 868/1731] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:56 2022] DELETE /identity/v3/users/dc95df3b90c04d43ba71f44f580d59ce => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:57.530959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:57.539321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:57.642333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788ffa-079b-4049-b5e8-4210a1895bdd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:57.762685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb812b-3f80-44e8-b8d2-a60fe95d2ad6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:57.781169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:57.782701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:57.782701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:57.782701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:57.785664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:57.817822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:57.818978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:57.818978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:57.819266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] PATH_INFO: `/v3/users/107aff39b2a94f6a85ffddbe19a029fc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:57.820629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107aff39b2a94f6a85ffddbe19a029fc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:57.822590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:57.906482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:57.909678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957269ea-ca6b-4baa-ab76-a264e5f4a9fe service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:57.927299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 869/1732] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:57.929954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6d1-bcc3-4ee1-a32b-f1394a718975 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:57.930241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6d1-bcc3-4ee1-a32b-f1394a718975 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:57.930633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6d1-bcc3-4ee1-a32b-f1394a718975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:57.956664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9388c6d1-bcc3-4ee1-a32b-f1394a718975 None None] MFA Rules not processed for user `5f4abead0b4e4ad9ab6e0bb267e5115e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:57.958036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9388c6d1-bcc3-4ee1-a32b-f1394a718975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.080353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 870/1733] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:58.083734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cc96-f8e4-474e-8fd9-14991a704bff None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:58.084223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cc96-f8e4-474e-8fd9-14991a704bff None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:58.087752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cc96-f8e4-474e-8fd9-14991a704bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:58.114111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cc22cc96-f8e4-474e-8fd9-14991a704bff None None] MFA Rules not processed for user `37bd85f0c7174b2785b1e7bc2d1f489b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:58.116623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc22cc96-f8e4-474e-8fd9-14991a704bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.122977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107aff39b2a94f6a85ffddbe19a029fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:58.123754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107aff39b2a94f6a85ffddbe19a029fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:58.128916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107aff39b2a94f6a85ffddbe19a029fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:58.152317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107aff39b2a94f6a85ffddbe19a029fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:58.264591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107aff39b2a94f6a85ffddbe19a029fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:58.289675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 871/1734] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:58.290875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:58.291427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:58.294229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:58.294974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:58.298820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 864/1735] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:44:57 2022] DELETE /identity/v3/users/107aff39b2a94f6a85ffddbe19a029fc => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:44:58.303140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:58.306120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.335352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] MFA Rules not processed for user `5153ddc5d5e4480a81e636fba58821d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:58.337781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.479527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 872/1736] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:58.480717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:58.486424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.489487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43fb8e-308d-4875-96fa-060a1c8cc205 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:58.492395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:58.497197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:58.498221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:58.498608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:58.498982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:58.501157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.522393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315c334-7418-4a2d-b486-145253fc3fda None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:58.543960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:58.551261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:58.554855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:58.554855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:58.560663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.602558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:58.604637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8bcf-82c4-4ef8-bddb-7a8a866dd2d2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:58.617078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 865/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:58.619116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:58.640928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:58.640928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:58.646861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:58.651256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:58.738412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:58.740113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:58.772503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 873/1738] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:58.819679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 866/1739] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:59.088432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:59.089975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.123695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44071b5-1e2b-493d-86c9-cc60ecc33a28 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:59.142167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:59.142842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.143144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.144507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] PATH_INFO: `/v3/projects/dc43369daa9d4ccfa51f20d950acfac6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.146307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc43369daa9d4ccfa51f20d950acfac6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:59.149203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:59.171724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:59.173286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.331453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc43369daa9d4ccfa51f20d950acfac6', 'request_id': 'req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.338645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bdee-1612-4ce3-aee8-843477d4ddd4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:59.364786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc43369daa9d4ccfa51f20d950acfac6', 'request_id': 'req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.456858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:59.457490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.457778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.458051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.476989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc43369daa9d4ccfa51f20d950acfac6', 'request_id': 'req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.503193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] The token cache is being invalidate because project dc43369daa9d4ccfa51f20d950acfac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:44:59.504257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.509695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.525807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 874/1740] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:59 2022] DELETE /identity/v3/projects/dc43369daa9d4ccfa51f20d950acfac6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:44:59.526475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:59.528174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.543991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:59.546075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf0409-5da1-4216-bbf8-92beae60a115 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:59.557557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 867/1741] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:59.560114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f968d-38aa-42c1-9d80-9ddcba169d9c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.560524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f968d-38aa-42c1-9d80-9ddcba169d9c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.560908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f968d-38aa-42c1-9d80-9ddcba169d9c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.562873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 868/1742] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 17:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:59.564172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067ceb-7901-42f2-9810-8374f5a5cede None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.564490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067ceb-7901-42f2-9810-8374f5a5cede None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.564870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067ceb-7901-42f2-9810-8374f5a5cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.591609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96067ceb-7901-42f2-9810-8374f5a5cede None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:59.592983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96067ceb-7901-42f2-9810-8374f5a5cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.603285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 869/1743] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:59.606142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f3c3-7a75-43cb-9361-66a31f3b7230 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.606142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f3c3-7a75-43cb-9361-66a31f3b7230 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.606142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f3c3-7a75-43cb-9361-66a31f3b7230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.668995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1276f3c3-7a75-43cb-9361-66a31f3b7230 None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:59.670938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1276f3c3-7a75-43cb-9361-66a31f3b7230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.679245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 870/1744] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:59.680724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.681122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.681500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.692497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3fee-ad0a-4ce8-8ba3-b883fa3aaff0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:59.709070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:59.710535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.713120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:59.714768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.716033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.716757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] PATH_INFO: `/v3/projects/3ac4314f17f144e1a12e95a21a55b970` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.722350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac4314f17f144e1a12e95a21a55b970)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:59.724993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 871/1745] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:59.725308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:59.726668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:59.728414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.748453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39919-0c0b-4900-86dc-a977952e11c8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:59.760013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:59.763278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.764452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.764955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.798602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:59.812374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:59.824622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 872/1746] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:44:59.825782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:44:59.839247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2d7-296d-4dca-894d-b1b32c510029 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:44:59.846892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:44:59.847982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.848503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.848951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.849851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:44:59.850508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:44:59.862316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc8ea8-7b78-4d18-b048-a68b7f686c8d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:44:59.880081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 873/1747] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:44:59.880081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f08abd-e597-4238-acb4-397af82233da None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.880081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f08abd-e597-4238-acb4-397af82233da None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.880081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f08abd-e597-4238-acb4-397af82233da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.895912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:59.902955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac4314f17f144e1a12e95a21a55b970', 'request_id': 'req-b83148d4-3577-45b6-aaba-d1cd7862eac4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.904027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3f08abd-e597-4238-acb4-397af82233da None None] MFA Rules not processed for user `924185a6e69b4e9aa8bcc456c096015e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:44:59.907355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3f08abd-e597-4238-acb4-397af82233da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:44:59.911132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac4314f17f144e1a12e95a21a55b970', 'request_id': 'req-b83148d4-3577-45b6-aaba-d1cd7862eac4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:44:59.977812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:59.982918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 874/1748] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:44:59.984130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de762-883e-4b2e-844d-713c106100ea None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:44:59.984475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de762-883e-4b2e-844d-713c106100ea None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:44:59.984813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de762-883e-4b2e-844d-713c106100ea None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:44:59.986336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 875/1749] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 17:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:44:59.987113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de762-883e-4b2e-844d-713c106100ea None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.007826 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac4314f17f144e1a12e95a21a55b970', 'request_id': 'req-b83148d4-3577-45b6-aaba-d1cd7862eac4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:00.026756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] The token cache is being invalidate because project 3ac4314f17f144e1a12e95a21a55b970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:00.027703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:00.029809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b83148d4-3577-45b6-aaba-d1cd7862eac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:00.037974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 875/1750] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:44:59 2022] DELETE /identity/v3/projects/3ac4314f17f144e1a12e95a21a55b970 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:00.040491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.041144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.041787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.118124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:00.131987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.145392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de762-883e-4b2e-844d-713c106100ea None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.155889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.156545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.156831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.157107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.157755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.159773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec134-dc7b-4cb5-ab35-3b638ac34108 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.306989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 876/1751] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:44:59 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:00.311525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.311525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.311828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.323022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 876/1752] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:00.323322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.327229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.360281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:00.361540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.367943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43afc-2497-4f94-9533-04337cdcd3c4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.473206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:00.513808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.514551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.514839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.515140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.515870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.518499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fc0e8-5b79-4ae5-a2e1-4634a00c2fe9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.563196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 877/1753] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:00.564545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.571344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.612316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 877/1754] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:00 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:00.614406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.614704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.615926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.670955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:00.672488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.690028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 878/1755] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:00.690028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.715195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b7f30-af39-42c6-b852-295c62161e29 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.716443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7a15-a921-46d8-aba8-08ec3fed88ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.720219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.720869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.721169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.721452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.732587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.733237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.736384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.736833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.737548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.742114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.748630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.750242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.759916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 879/1756] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:00.759916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.760646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:00.762794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 878/1757] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:00.763717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.804913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9b30d-7d23-4cb4-8b1a-ad31a7825b00 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.805511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.806478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.806910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.807678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.808714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:00.809286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.811149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.815450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946ad6-8d4e-4f3a-8763-8b8e8cb2e79b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.826120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.828474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.828474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.828474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] PATH_INFO: `/v3/projects/517d1c2461dc4ce6a54d5b204c83ab13` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.829467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517d1c2461dc4ce6a54d5b204c83ab13)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.830738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 879/1758] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:00.831782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.834690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.844056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1611-022c-42fb-b7a9-0bfaa9c511cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.856323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.857200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.857482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.860005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.860737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.865160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:00.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 880/1759] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:00.895924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:00.936593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd6365-9b5f-4f61-88bb-267ed46b965b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:00.942138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:00.942894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:00.943402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:00.943789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:00.944620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:00.948200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:01.067916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 881/1760] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:00 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:01.069896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:01.070942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517d1c2461dc4ce6a54d5b204c83ab13', 'request_id': 'req-30dc3b86-da12-4d72-b953-59cfa90f0172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:01.092801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517d1c2461dc4ce6a54d5b204c83ab13', 'request_id': 'req-30dc3b86-da12-4d72-b953-59cfa90f0172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:01.184469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517d1c2461dc4ce6a54d5b204c83ab13', 'request_id': 'req-30dc3b86-da12-4d72-b953-59cfa90f0172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:01.222481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] The token cache is being invalidate because project 517d1c2461dc4ce6a54d5b204c83ab13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:01.224278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:01.226379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30dc3b86-da12-4d72-b953-59cfa90f0172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:01.234942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 880/1761] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:00 2022] DELETE /identity/v3/projects/517d1c2461dc4ce6a54d5b204c83ab13 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:01.236890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.255625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.255932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.257716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 881/1762] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 17:45:01 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:45:01.258508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:01.269591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:01.321678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b8664-6ce9-4d4e-be63-e47821be7a86 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:01.336722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:01.338204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.339454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.344675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] PATH_INFO: `/v3/projects/d058d98f4c8e4cfdb04a6a3558add380/users/43350a58ad2d4e9fb8cbd9125da4c7d1/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.345982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:01.386977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d058d98f4c8e4cfdb04a6a3558add380, user_id=43350a58ad2d4e9fb8cbd9125da4c7d1, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:01.397300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:01.481949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae6d2-f7bb-4f06-b5bd-77e6b988fb7d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:01.487368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:01.488005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.488285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.488573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.489202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:01.491625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d66ace-5eaf-4f3d-8c62-cbedf32fe257 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:01.511019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 882/1763] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:01 2022] PUT /identity/v3/projects/d058d98f4c8e4cfdb04a6a3558add380/users/43350a58ad2d4e9fb8cbd9125da4c7d1/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:01.513874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:01.517701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:01.625535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 882/1764] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:01 2022] POST /identity/v3/users => generated 283 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:01.629223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f360-cfb8-4254-b22d-2d9bf109fdb3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.629571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f360-cfb8-4254-b22d-2d9bf109fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.629858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f360-cfb8-4254-b22d-2d9bf109fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.709459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1990f360-cfb8-4254-b22d-2d9bf109fdb3 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:01.712918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1990f360-cfb8-4254-b22d-2d9bf109fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:01.718691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:01.748695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67959f3-a894-41d4-a1ab-58bb2c375aa3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:01.760652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:01.764134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.764134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.766122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] PATH_INFO: `/v3/users/3e2ad0a3aee142288a140c552ebac66a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.770003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2ad0a3aee142288a140c552ebac66a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:01.776683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:01.864365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 883/1765] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 17:45:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:01.866039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:01.867190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:01.867190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:01.921707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:01.929518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:01.958079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 884/1766] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:01.958079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:01.972095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:01.994273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6026d3-91cb-461f-8b8c-68ab4682d29e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.008589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.012648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.012648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.012648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.012648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.014622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.034863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 885/1767] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:02.035949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:02.054242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94494-cc8f-4354-9c39-942b67e5c3cb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.069677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2ad0a3aee142288a140c552ebac66a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:02.070948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2ad0a3aee142288a140c552ebac66a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:02.072141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.072788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.073085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.073369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.076044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.081531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2ad0a3aee142288a140c552ebac66a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:02.097458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2ad0a3aee142288a140c552ebac66a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:02.099147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.101291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.134117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 886/1768] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:02.135268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:02.160216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.199361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:02.200221 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2ad0a3aee142288a140c552ebac66a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:02.243051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 883/1769] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:01 2022] DELETE /identity/v3/users/3e2ad0a3aee142288a140c552ebac66a => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:02.253684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:02.260078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.287061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c9ac-c3f7-4a7b-bfd3-0f154b80f896 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.442718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.443641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.446749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.447848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.465221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.475163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3f2b-c6b1-4fe9-bf19-ee67039c888e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.490037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dff57-205a-4851-b853-9847835d17ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.490858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dff57-205a-4851-b853-9847835d17ab service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.493821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dff57-205a-4851-b853-9847835d17ab service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.494207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dff57-205a-4851-b853-9847835d17ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.502510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-679dff57-205a-4851-b853-9847835d17ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.525689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dff57-205a-4851-b853-9847835d17ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.529103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dff57-205a-4851-b853-9847835d17ab service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.543307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 884/1770] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:02.544612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dff57-205a-4851-b853-9847835d17ab service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:02.548205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-679dff57-205a-4851-b853-9847835d17ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.617380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.618889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.646232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 887/1771] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:02.685126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dff57-205a-4851-b853-9847835d17ab service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.693726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.694601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.694895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.695222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.696043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.697901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133dfc-b76d-4eb2-8d26-89ad059ecc93 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.710609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 885/1772] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:02.715665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:02.728085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe9cb7-621a-4108-97e1-f2f8a4a7ae46 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:02.751734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:02.752703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.753108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.753508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] PATH_INFO: `/v3/projects/a46d4ec94a114e138ce8b2b30fecb728/users/8e2c5af0464a45b9a148630e82e7f480/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.796112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46d4ec94a114e138ce8b2b30fecb728, user_id=8e2c5af0464a45b9a148630e82e7f480, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:02.802276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b47cd-c630-472d-8231-e4ce56d0b486 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:02.818491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:02.871987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.872297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.872644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:02.903686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] MFA Rules not processed for user `5f4abead0b4e4ad9ab6e0bb267e5115e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:02.905498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:02.927844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 888/1773] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:02 2022] PUT /identity/v3/projects/a46d4ec94a114e138ce8b2b30fecb728/users/8e2c5af0464a45b9a148630e82e7f480/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:02.939259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:02.939930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:02.940418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:03.014062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 886/1774] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:03.041729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:03.052724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] MFA Rules not processed for user `8e2c5af0464a45b9a148630e82e7f480`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:03.053995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:03.237836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 889/1775] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:03.240035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:03.285444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30732be-6e7e-4e93-ab76-2c1cf5906e84 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:03.539022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:03.541896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:03.542190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:03.542932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:03.543634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:03.551367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:03.731712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 887/1776] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:03 2022] POST /identity/v3/projects => generated 365 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:03.736989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:03.759556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3a6c6-756f-448c-8c73-111f21c02405 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:03.854068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:03.854955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:03.855291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:03.855944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:03.856728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:03.860106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.082474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 890/1777] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:03 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:04.084126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:04.101112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d04f1-b135-4980-871c-fc533201429b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:04.113016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:04.115016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.116361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.118682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:04.119181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.120076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:04.120702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:04.122911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.144769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:04.151285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10eb38-99cd-49b0-8fab-a3971396c54c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:04.177909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:04.178921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 888/1778] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:04.182029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.183431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:04.185296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.185594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] PATH_INFO: `/v3/projects/25f52b8f73804649823d77b56859e471` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.188650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f52b8f73804649823d77b56859e471)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:04.201538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.206601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551dd1f-ea26-4105-b3d4-4b7daa83754c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:04.230606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:04.230606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.230606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.230606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] PATH_INFO: `/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c/users/8898e36daa384fa9b80a0b61d022fac0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.254595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc42e249c574522aa7eb4b0ef3eab0c, user_id=8898e36daa384fa9b80a0b61d022fac0, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:04.258816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.377162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 889/1779] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:04 2022] PUT /identity/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c/users/8898e36daa384fa9b80a0b61d022fac0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:04.377162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:04.436378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f52b8f73804649823d77b56859e471', 'request_id': 'req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:04.456559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9f5a-39b8-42e7-baa1-0098d560bdbd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:04.463787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f52b8f73804649823d77b56859e471', 'request_id': 'req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:04.523031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:04.523901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.524329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.524786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.525605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:04.527447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0882-87ca-40cb-8787-75abf91c4d88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.546266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f52b8f73804649823d77b56859e471', 'request_id': 'req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:04.566886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 890/1780] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:04.569175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8215-18a7-46be-adf2-1bc0cf8627f3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.569644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8215-18a7-46be-adf2-1bc0cf8627f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.570365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8215-18a7-46be-adf2-1bc0cf8627f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.574936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] The token cache is being invalidate because project 25f52b8f73804649823d77b56859e471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:04.575298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:04.579435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:04.598246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 891/1781] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:04 2022] DELETE /identity/v3/projects/25f52b8f73804649823d77b56859e471 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:04.605909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:04.610378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:04.613678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-274a8215-18a7-46be-adf2-1bc0cf8627f3 None None] MFA Rules not processed for user `e126e83baeee403f9d8f0ca39a75bb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:04.629138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-274a8215-18a7-46be-adf2-1bc0cf8627f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:04.656784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842922ce-264c-4c9e-a7d7-02f3c2d5cab9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:04.665872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:04.670982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:04.671699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.672145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.672845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] PATH_INFO: `/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c/users/8898e36daa384fa9b80a0b61d022fac0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.678659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc42e249c574522aa7eb4b0ef3eab0c, user_id=8898e36daa384fa9b80a0b61d022fac0, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:04.681729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14863c9b-2440-4a20-beb3-2698de9bf302 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:04.705989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 892/1782] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:04 2022] PUT /identity/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c/users/8898e36daa384fa9b80a0b61d022fac0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:04.707794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be963-b77a-4404-9ff8-5458f6be7026 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.709979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be963-b77a-4404-9ff8-5458f6be7026 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.710410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be963-b77a-4404-9ff8-5458f6be7026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.755432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:04.763035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 891/1783] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:04.764830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:04.767369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:04.767911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:04.805634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-632be963-b77a-4404-9ff8-5458f6be7026 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:04.811880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-632be963-b77a-4404-9ff8-5458f6be7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:04.856460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] MFA Rules not processed for user `8898e36daa384fa9b80a0b61d022fac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:04.859400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:05.004846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 893/1784] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:05.009537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.010090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.010540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.042039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:05.044532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:05.070065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 892/1785] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:05.078160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 894/1786] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:45:05.082619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.090165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.094142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:05.097480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2ddf8-babb-4f84-876f-e5cdfe3560e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:05.112942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:05.113836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.114266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.114686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.115623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:05.116104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:05.119071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:05.171900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 893/1787] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:05.179939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.204933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39351e16-f6ce-4e41-8f63-cd5a9d2c6bf5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:05.242282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:05.243100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.243523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.243957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.244739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:05.248402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:05.287395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c342-30f9-45c4-8752-a0298983846b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:05.296097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:05.296097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.296097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.296097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.310186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:05.315263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:05.367236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 895/1788] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:05.406872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 894/1789] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:05 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:05.411025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.429325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79bbb-d77c-4b57-9b60-ab859b314579 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:05.695891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:05.702303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.703823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.705570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.706960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:05.711752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:05.777438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.832142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 896/1790] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:05 2022] POST /identity/v3/users => generated 281 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:05.838612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:05.856101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:05.883666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6561c-9159-458a-a252-bca3c3f298bc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:05.909882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:05.910497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:05.910778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:05.911140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:05.920542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:05.936413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:05.977046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 897/1791] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:05.981538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:06.031370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe812a-a7fa-42f8-806c-5832d60420b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.042341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42988dc2-935a-4013-9e7a-2b3ed8cd5b08 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.058780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.058780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.058780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.060156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.060695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.060977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.061252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.065057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.065806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.075857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:06.077729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:06.115148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 898/1792] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:06.119168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:06.150048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd890c-0ccc-4a19-82d3-f41e8f52cb39 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.187308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.189560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.191479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.201392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] PATH_INFO: `/v3/projects/6846b4eb2b464e6593a1a29b2ef3d094/users/daa4bf9decc141eab7f88f03be41f9a6/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.253733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:06.258057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.259609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f6273-52b3-4972-811c-2bb024aa6e7c service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:06.268097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6846b4eb2b464e6593a1a29b2ef3d094, user_id=daa4bf9decc141eab7f88f03be41f9a6, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.274575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085cd78-a5bc-41c9-8f17-706169fca8bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:06.297761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 895/1793] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:06.367022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.373036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.373560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.388055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 899/1794] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:06 2022] PUT /identity/v3/projects/6846b4eb2b464e6593a1a29b2ef3d094/users/daa4bf9decc141eab7f88f03be41f9a6/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:06.398708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.399188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.399576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.509321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] MFA Rules not processed for user `daa4bf9decc141eab7f88f03be41f9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:06.510907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:06.520288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] MFA Rules not processed for user `43350a58ad2d4e9fb8cbd9125da4c7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:06.528063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:06.655412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 900/1795] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:06.699945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:06.701803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:06.816428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 896/1796] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:06.819155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:06.820783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:06.859984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f89b-b12f-459b-899a-68df3b7458f2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.881451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.883876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.886104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.887335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.898416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.899941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:06.914906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 901/1797] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:06.929818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a20cd-ff08-49a1-a724-4d837cbc9fbc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.941453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.942138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.942414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.942697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.944998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.946248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:06.947773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:06.971221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1a68-b133-4cda-a31d-8cdba51a3266 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:06.984248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:06.985085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:06.985475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:06.985857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] PATH_INFO: `/v3/users/daa4bf9decc141eab7f88f03be41f9a6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:06.987272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa4bf9decc141eab7f88f03be41f9a6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:06.989543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:07.112813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 897/1798] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:06 2022] POST /identity/v3/projects => generated 371 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:07.117467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:07.289185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bdca4-e303-4e7c-bac4-4a7f19a73142 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:07.296969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:07.297590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:07.297872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:07.298149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:07.306220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:07.306220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:07.312627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa4bf9decc141eab7f88f03be41f9a6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:07.314476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa4bf9decc141eab7f88f03be41f9a6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:07.315318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa4bf9decc141eab7f88f03be41f9a6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:07.340173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa4bf9decc141eab7f88f03be41f9a6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:07.384742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9dd4014e-80ee-4d06-b613-66e745104308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa4bf9decc141eab7f88f03be41f9a6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:07.428983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 898/1799] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:07 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:07.430334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:07.433565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:07.449816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516a2f-b3c9-4eac-aee9-7297582fee17 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:07.457963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:07.458839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:07.459961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:07.461749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:07.463035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:07.466048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:07.493552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 899/1800] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:07.501364 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:07.503954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 902/1801] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:06 2022] DELETE /identity/v3/users/daa4bf9decc141eab7f88f03be41f9a6 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:07.513924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30630a2-a0e3-47da-9863-f127c8c70f4e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:07.518515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:07.519048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:07.519495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:07.540510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:07.541763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:07.629257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:07.630084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:07.630585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:07.631286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] PATH_INFO: `/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba/users/6ac5fca3087b47ebaef141ae36877e49/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:07.674365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2588a1c0b7034ef9a98fb4acfec6b4ba, user_id=6ac5fca3087b47ebaef141ae36877e49, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:07.681249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:07.748472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 903/1802] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:07.754536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:07.831385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 900/1803] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:07 2022] PUT /identity/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba/users/6ac5fca3087b47ebaef141ae36877e49/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:07.831994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:07.848174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516cbf2-6efe-45fc-bdae-2dcf031fc2b6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:07.874011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:07.877442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:07.956542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:08.035348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:08.036165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:08.036570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:08.036850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:08.037525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:08.039847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:08.063308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c2ea-5b60-4acf-9678-56416c2448ea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:08.071684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:08.072542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:08.072830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:08.073110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:08.086934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 904/1804] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:08.087323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:08.087323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5ce2a-1c0e-4c42-a6f5-b3c951347206 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:08.088378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:08.116596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 901/1805] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:08.118468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2feb-ff47-4895-b605-26a73f52ae28 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:08.125895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:08.126796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:08.127279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:08.127678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] PATH_INFO: `/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba/users/6ac5fca3087b47ebaef141ae36877e49/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:08.129793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2588a1c0b7034ef9a98fb4acfec6b4ba, user_id=6ac5fca3087b47ebaef141ae36877e49, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:08.133272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:08.146871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 905/1806] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:08 2022] PUT /identity/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba/users/6ac5fca3087b47ebaef141ae36877e49/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:08.629179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:08.629611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:08.630003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:08.726550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:08.726550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:08.907325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 902/1807] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:45:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:45:09.484419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:09.491451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:09.644874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873152-d9cf-41ad-bedf-0eabb8014632 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:09.651032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:09.652975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:09.653258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:09.653705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:09.664487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:09.666342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:09.692635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 906/1808] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:45:09.723800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:10.081583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:11.067306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:11.072285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:11.341046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7be85-682b-47f7-a060-82f6cf1e512f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:11.385902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:11.390419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:11.398159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:11.399443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] PATH_INFO: `/v3/projects/6846b4eb2b464e6593a1a29b2ef3d094` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:11.404401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6846b4eb2b464e6593a1a29b2ef3d094)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:11.412699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:11.650773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6846b4eb2b464e6593a1a29b2ef3d094', 'request_id': 'req-2b923765-ad03-455a-9a1e-ea95b7e14d31'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:11.673062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:11.677104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:11.735393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6846b4eb2b464e6593a1a29b2ef3d094', 'request_id': 'req-2b923765-ad03-455a-9a1e-ea95b7e14d31'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:11.736289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2a3f8-08bb-411e-841a-6ce6fc146d70 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:11.737776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6846b4eb2b464e6593a1a29b2ef3d094', 'request_id': 'req-2b923765-ad03-455a-9a1e-ea95b7e14d31'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:11.920314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:11.921186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:11.921473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:11.921751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] PATH_INFO: `/v3/users/8e2c5af0464a45b9a148630e82e7f480` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:11.924543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2c5af0464a45b9a148630e82e7f480)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:11.931568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:11.989193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] The token cache is being invalidate because project 6846b4eb2b464e6593a1a29b2ef3d094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:11.989406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.005942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b923765-ad03-455a-9a1e-ea95b7e14d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.005942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 903/1809] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:11 2022] DELETE /identity/v3/projects/6846b4eb2b464e6593a1a29b2ef3d094 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:12.009606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315729cc-8654-4ea1-a8af-f4f5f044f46c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.009606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315729cc-8654-4ea1-a8af-f4f5f044f46c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.009606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315729cc-8654-4ea1-a8af-f4f5f044f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.068981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-315729cc-8654-4ea1-a8af-f4f5f044f46c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:12.070328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-315729cc-8654-4ea1-a8af-f4f5f044f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.101548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 904/1810] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:12.109788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.110315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.111751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.149964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:12.156462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.169716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 905/1811] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:12.174342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:12.203604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140a27c-71c9-4836-ad52-8a618a7d57fb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:12.217273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:12.218460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.218846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.219232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.224442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:12.224895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:12.227229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6554d3-c2bc-483f-a3ba-070cddaa32ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:12.236799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2c5af0464a45b9a148630e82e7f480'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.242657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2c5af0464a45b9a148630e82e7f480'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.242657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2c5af0464a45b9a148630e82e7f480'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.267461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2c5af0464a45b9a148630e82e7f480'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.268196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 906/1812] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:12.269614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e61a-d658-444b-8700-413996e3fb55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.272536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e61a-d658-444b-8700-413996e3fb55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.273203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e61a-d658-444b-8700-413996e3fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.300652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2c5af0464a45b9a148630e82e7f480'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:12.319318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c138e61a-d658-444b-8700-413996e3fb55 None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:12.320751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c138e61a-d658-444b-8700-413996e3fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.372067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 907/1813] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:11 2022] DELETE /identity/v3/users/8e2c5af0464a45b9a148630e82e7f480 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:12.374052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:12.374896 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.410287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:12.415589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 907/1814] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Aug 24 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:12.426301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.428864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.430512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.495824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:12.497229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.615163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56b6a-8146-40d7-982a-80f810b7d672 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:12.632373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:12.635517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.636974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.638905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.640348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:12.645944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 908/1815] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:12.647050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:12.648582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.665279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:12.772987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542390a-4c49-440a-ba40-f8ce9c6e044f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:12.779458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:12.780351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.780804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.781233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.790298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:12.793094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:12.826434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 909/1816] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:12.827790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:12.831809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:12.850905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6053-b7fc-4378-8f43-6c592c51813d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:12.855634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:12.856319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:12.856631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:12.856964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:12.867759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:12.869428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:12.883042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 910/1817] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:12.999525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 908/1818] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:12 2022] POST /identity/v3/projects => generated 383 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:13.003626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:13.032580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff00e-c54e-439b-9117-a6d3f219ae15 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:13.185267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:13.186689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:13.187341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:13.188532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:13.189914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:13.192910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:13.530281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 911/1819] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:13 2022] POST /identity/v3/users => generated 292 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:13.534445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:13.555386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106a44-a4a6-42ea-9b84-2c8b18fd5a41 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:13.566194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:13.566851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:13.567169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:13.567447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:13.568113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:13.569761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:13.595717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 909/1820] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:13.600265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:13.617298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239539b-1fc0-4cb0-b286-2d9646f8d8ff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:13.632558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:13.636484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:13.636484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:13.636484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:13.636484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:13.638563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8976-0e85-4bca-923c-c9327d336f9c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:13.675362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 912/1821] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:13.681160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:13.706216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7feaa5-bca2-455d-ba71-a8434f876da3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:13.722660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:13.722660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:13.722660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:13.722660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] PATH_INFO: `/v3/projects/5271919a9ec84880b385a0369e63bbac/users/ffe7e84ea07843bb99d2cbd6afa54f42/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:13.739760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271919a9ec84880b385a0369e63bbac, user_id=ffe7e84ea07843bb99d2cbd6afa54f42, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:13.744602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:14.056473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:14.064397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 910/1822] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:13 2022] PUT /identity/v3/projects/5271919a9ec84880b385a0369e63bbac/users/ffe7e84ea07843bb99d2cbd6afa54f42/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:14.079963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:14.080374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:14.080591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:14.216010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] MFA Rules not processed for user `ffe7e84ea07843bb99d2cbd6afa54f42`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:14.216010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:14.335348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 913/1823] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:14.340081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:14.545587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bb91-b67a-47b2-b4df-cb2bd120be9f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:14.560194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:14.563713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:14.563713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:14.563713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:14.563713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:14.564548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:14.877633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 911/1824] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:14 2022] POST /identity/v3/projects => generated 383 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:45:14.878033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:14.908781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c5723-53ad-4661-93be-8e49cf78955d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:15.044120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:15.045447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.046030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.046534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.047554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:15.050918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:15.301475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 914/1825] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:14 2022] POST /identity/v3/users => generated 292 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:15.307864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:15.327198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:15.337211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2238-997d-40f6-9dd1-e3076c380090 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:15.346158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:15.347915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.348458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.348966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.349920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:15.352180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:15.371737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 912/1826] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:15.375269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:15.399466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b662-d548-4a9a-b236-0acd10dbddee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:15.410677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:15.411697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.412178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.412786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.415170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:15.417650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353a68-d4e2-4b0d-aaf5-28419ab2a5a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:15.475264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 915/1827] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:15.478672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:15.492188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808437a4-3b12-4804-a0fa-588c9b5f4b9b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:15.499680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:15.501707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.502226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.502888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] PATH_INFO: `/v3/projects/bf9b2a5399234adb99e9544267a1df48/users/86f374d444094369b0bccb3c2a8d140a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.551474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9b2a5399234adb99e9544267a1df48, user_id=86f374d444094369b0bccb3c2a8d140a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:15.560556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d64e-21e2-483d-9d41-4574a105286c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:15.613158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff394-53b8-460e-a3e6-ab7ee63e794b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.613311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff394-53b8-460e-a3e6-ab7ee63e794b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.613575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff394-53b8-460e-a3e6-ab7ee63e794b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.617017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 916/1828] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:45:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:45:15.778516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bfc6-14f8-489f-92a8-127f025eae1c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.778954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bfc6-14f8-489f-92a8-127f025eae1c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.779163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bfc6-14f8-489f-92a8-127f025eae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:15.831999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7639bfc6-14f8-489f-92a8-127f025eae1c None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:15.833229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7639bfc6-14f8-489f-92a8-127f025eae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:15.871129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 913/1829] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:15 2022] PUT /identity/v3/projects/bf9b2a5399234adb99e9544267a1df48/users/86f374d444094369b0bccb3c2a8d140a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:15.889931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:15.890374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:15.890899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:16.047014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] MFA Rules not processed for user `86f374d444094369b0bccb3c2a8d140a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:16.050004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:16.055484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 917/1830] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:45:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:16.099296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:16.128950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285537-4720-4e42-8178-a543fc1ba305 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:16.129310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285537-4720-4e42-8178-a543fc1ba305 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:16.129760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285537-4720-4e42-8178-a543fc1ba305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:16.353709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-72285537-4720-4e42-8178-a543fc1ba305 None None] MFA Rules not processed for user `6ac5fca3087b47ebaef141ae36877e49`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:16.353709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-72285537-4720-4e42-8178-a543fc1ba305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:16.356375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 914/1831] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:16.356909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 918/1832] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:45:16.362648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:16.363237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:16.363361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:16.363818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:16.407829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] MFA Rules not processed for user `43350a58ad2d4e9fb8cbd9125da4c7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:16.428458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:16.543043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aca13-7f63-4a43-884a-78607c3ae63b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:16.558467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:16.560744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:16.560744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:16.560744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:16.563894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:16.570863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:16.601649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 919/1833] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:16.656888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:16.659499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:16.707996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75d19-8ab0-4622-9d00-1a0a25146079 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:16.720530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:16.722618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:16.724604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:16.725078 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] PATH_INFO: `/v3/projects/a46d4ec94a114e138ce8b2b30fecb728` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:16.730694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46d4ec94a114e138ce8b2b30fecb728)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:16.735956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:17.000181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 915/1834] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:16 2022] POST /identity/v3/projects => generated 383 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:17.004717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:17.124830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46d4ec94a114e138ce8b2b30fecb728', 'request_id': 'req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:17.144280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46d4ec94a114e138ce8b2b30fecb728', 'request_id': 'req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:17.159740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46d4ec94a114e138ce8b2b30fecb728', 'request_id': 'req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:17.206095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584753a-d524-42e5-b80c-e56ccf7d19db admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:17.341542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:17.342857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:17.343431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:17.344127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:17.345540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:17.349061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:17.460367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] The token cache is being invalidate because project a46d4ec94a114e138ce8b2b30fecb728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:17.460367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:17.460367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:17.460367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 920/1835] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:16 2022] DELETE /identity/v3/projects/a46d4ec94a114e138ce8b2b30fecb728 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:17.460367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:17.461288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:17.486934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 916/1836] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:17 2022] POST /identity/v3/users => generated 298 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:17.486934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:17.497506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:17.627943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b338f-082e-45f9-a3d9-b50e3589e7d0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:17.638954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:17.656592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:17.657112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:17.657648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:17.661745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:17.684931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:17.687264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:17.701950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 921/1837] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:17.703474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:17.705916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:17.739038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c17eb-1c90-434f-9a0b-0b797cedbe31 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:17.752717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32eff-8608-4aae-a167-170076d28686 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:17.756682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:17.757997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:17.758562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:17.759167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:17.761525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:17.767726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:17.768451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:17.768740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:17.769016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] PATH_INFO: `/v3/users/8898e36daa384fa9b80a0b61d022fac0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:17.770314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8898e36daa384fa9b80a0b61d022fac0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:17.784988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:17.955693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:17.958535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:17.988211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 917/1838] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:17.990172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:17.994153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:18.025684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615b96b-cda0-4356-87e9-120c4c3e8e7e service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:18.031239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:18.032609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.032945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.033284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.034418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:18.036218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab07e-33e0-4757-a94f-7fcc33303969 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:18.041473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:18.051577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 918/1839] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:18.053128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52b76-4cb1-488c-8cbf-71ae800c6255 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.053405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52b76-4cb1-488c-8cbf-71ae800c6255 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.053770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52b76-4cb1-488c-8cbf-71ae800c6255 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.056057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 919/1840] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:45:18.057192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52b76-4cb1-488c-8cbf-71ae800c6255 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:18.078139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52b76-4cb1-488c-8cbf-71ae800c6255 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:18.084797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:18.086106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.086720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.087409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] PATH_INFO: `/v3/projects/0c3558b76c66461f9b998354cf8fce2a/users/ecb55f620de64d4bae2bf3b9049f74f0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.139271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8898e36daa384fa9b80a0b61d022fac0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:18.145705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3558b76c66461f9b998354cf8fce2a, user_id=ecb55f620de64d4bae2bf3b9049f74f0, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:18.147661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8898e36daa384fa9b80a0b61d022fac0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:18.150154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8898e36daa384fa9b80a0b61d022fac0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:18.153851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ceee-76d6-46ca-ad64-bbc4ef33b060 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:18.175153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8898e36daa384fa9b80a0b61d022fac0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:18.263646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8898e36daa384fa9b80a0b61d022fac0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:18.277176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 920/1841] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:18 2022] PUT /identity/v3/projects/0c3558b76c66461f9b998354cf8fce2a/users/ecb55f620de64d4bae2bf3b9049f74f0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:18.285349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f84c5-611c-4712-b211-a5b13043a651 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.290228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f84c5-611c-4712-b211-a5b13043a651 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.290228 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f84c5-611c-4712-b211-a5b13043a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.316159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 922/1842] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:17 2022] DELETE /identity/v3/users/8898e36daa384fa9b80a0b61d022fac0 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:18.321560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:18.330719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:18.352066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-307f84c5-611c-4712-b211-a5b13043a651 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:18.354297 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-307f84c5-611c-4712-b211-a5b13043a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:18.484214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a38292-5e1a-4a17-92c3-20718285c299 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:18.493180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:18.495110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.495110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.495110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.501620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:18.504365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:18.530476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 923/1843] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:18.536358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:18.546940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 921/1844] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:45:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:18.551605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bc6e-1c3f-498d-8960-78dd6bbedd68 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:18.557900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:18.559546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.560126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.560683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] PATH_INFO: `/v3/projects/0c3558b76c66461f9b998354cf8fce2a/users/ecb55f620de64d4bae2bf3b9049f74f0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.563447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3558b76c66461f9b998354cf8fce2a, user_id=ecb55f620de64d4bae2bf3b9049f74f0, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:18.566543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:18.583628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 924/1845] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:18 2022] PUT /identity/v3/projects/0c3558b76c66461f9b998354cf8fce2a/users/ecb55f620de64d4bae2bf3b9049f74f0/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:18.597800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.598427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.599545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.639104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] MFA Rules not processed for user `ecb55f620de64d4bae2bf3b9049f74f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:18.645252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:18.747329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 922/1846] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:18.758915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:18.761482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:18.880315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add614-cec7-44c8-91d1-05aee7a6596c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:18.886401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:18.888228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:18.888570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:18.888986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:18.896299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:19.023710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:19.025370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ebcd1-f7cd-448c-98d5-88e466beefc7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:19.045939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 925/1847] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:19.723381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:19.741813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:19.892132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:19.939219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6285aa-f67c-4606-a730-aa4b3a4db5c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:19.953099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:19.954270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:19.954831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:19.955381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] PATH_INFO: `/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:19.957570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc42e249c574522aa7eb4b0ef3eab0c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:19.961154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:20.098758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc42e249c574522aa7eb4b0ef3eab0c', 'request_id': 'req-4380bdd5-863f-4489-a686-c4563cd0e95c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:20.121858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc42e249c574522aa7eb4b0ef3eab0c', 'request_id': 'req-4380bdd5-863f-4489-a686-c4563cd0e95c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:20.229648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc42e249c574522aa7eb4b0ef3eab0c', 'request_id': 'req-4380bdd5-863f-4489-a686-c4563cd0e95c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:20.262983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] The token cache is being invalidate because project 1bc42e249c574522aa7eb4b0ef3eab0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:20.263449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:20.265101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4380bdd5-863f-4489-a686-c4563cd0e95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:20.267196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 923/1848] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:19 2022] DELETE /identity/v3/projects/1bc42e249c574522aa7eb4b0ef3eab0c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:20.277466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:20.278010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:20.278159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:20.324469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:20.329310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:20.341609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:20.512402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 926/1849] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:20.520164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:20.521317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:20.521842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:20.589530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:20.599511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:20.627635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 924/1850] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:45:20.629225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:20.654199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a931f-a6ea-456b-9c03-cb35420baebc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:20.663649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:20.664397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:20.664779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:20.665127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:20.665740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:20.666050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:20.672724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:20.713285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 927/1851] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:20.714729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:20.737021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3284-6d7d-4bf0-8c17-3bf5383f1955 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:20.763151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:20.766372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:20.766799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:20.767071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:20.770380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:20.773925 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:20.898282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 925/1852] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:20 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:20.902217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:20.907416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:20.910205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:20.924675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd925-8187-466f-bcab-c372d506a0c2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:21.095137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448f3d2-cfb6-4810-87c3-5524d2ff1d31 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:21.125278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:21.127242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.128072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.128668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.133129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:21.182915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:21.192847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:21.241787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:21.242429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.242716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.242999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.250395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:21.252588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:21.261053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 926/1853] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:21.483486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 928/1854] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:20 2022] POST /identity/v3/users => generated 294 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:21.484836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:21.507837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314ca23-1319-42b7-b714-837ed28eefb4 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:21.522208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:21.523589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.524799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.525201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.527531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:21.531953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:21.561801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 927/1855] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:21.577173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:21.626699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c52fd-3178-40eb-a533-380096332842 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:21.644561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:21.645403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.645775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.647343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.649424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:21.661182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46dda0-9c77-41cb-97d3-6b03373da362 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:21.698298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 929/1856] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:21.699479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:21.721177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa93f9-4270-40fe-843b-6bb7ff61e61d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:21.728629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:21.730576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.731052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.731630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] PATH_INFO: `/v3/projects/caed193b6b11467bb4a29799921a518b/users/4c8f0c08d43245bfbf8ab67b11f2f223/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.757687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caed193b6b11467bb4a29799921a518b, user_id=4c8f0c08d43245bfbf8ab67b11f2f223, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:21.774092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:21.923931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 928/1857] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:21 2022] PUT /identity/v3/projects/caed193b6b11467bb4a29799921a518b/users/4c8f0c08d43245bfbf8ab67b11f2f223/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:21.926075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:21.926747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:21.927055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:21.969147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] MFA Rules not processed for user `4c8f0c08d43245bfbf8ab67b11f2f223`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:21.971969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:22.064260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:22.085566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.085856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 930/1858] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:22.215197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769af2-7d55-4704-983d-57bb98e8c827 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.230179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.231244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.231376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.231747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.234023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.236148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.366480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 929/1859] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:22 2022] POST /identity/v3/projects => generated 389 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:22.371293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.397721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93082a2-f41d-4526-b560-b7401880b449 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.489485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.493337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.493337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.493337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.493337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.494586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.538307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:22.601318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 931/1860] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:22 2022] POST /identity/v3/users => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:22.605667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.616242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc6cc-dfcb-4802-a928-4f43dad572f7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.623303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.623922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.624206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.624566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.625215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.626876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.638696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 930/1861] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:22.646274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.656853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434522-e933-441f-93d5-04e93f30822f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.661499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.662224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.662511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.662822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] PATH_INFO: `/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea/users/cd8b4d8164534507ac7b946ff81e1463/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.678928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a09185b0fa4b648a45d3a1bf0119ea, user_id=cd8b4d8164534507ac7b946ff81e1463, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.681713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.747620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.749355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:22.761874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 932/1862] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:22 2022] PUT /identity/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea/users/cd8b4d8164534507ac7b946ff81e1463/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:22.766007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.810673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b14c-3b99-4482-9ebb-ea5e5939a8ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.834110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766e334-fe36-4e89-88c2-d05aace2acc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.839173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.840155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.840510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.840977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.841713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.843527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.859176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 933/1863] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:22.863420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:22.865611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.866250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.866536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.866814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.869605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:22.884048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba4f5-fe06-4a6f-a9d8-1909d86e3bcd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:22.886256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:22.887750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.888507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.888866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] PATH_INFO: `/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea/users/cd8b4d8164534507ac7b946ff81e1463/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.891802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a09185b0fa4b648a45d3a1bf0119ea, user_id=cd8b4d8164534507ac7b946ff81e1463, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.894834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75019bf5-0d53-4cf4-bea3-90271541048f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.904182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:22.918835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 934/1864] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:22 2022] PUT /identity/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea/users/cd8b4d8164534507ac7b946ff81e1463/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:22.921014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:22.921387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:22.921854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:22.965883 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] MFA Rules not processed for user `cd8b4d8164534507ac7b946ff81e1463`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:22.967164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:22.974599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:22.976446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:22.987225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 931/1865] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:23.069821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 935/1866] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:23.095772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:23.095772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:23.099964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6073-c108-4d61-9170-092f6a718b17 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:23.155953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:23.156573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:23.156856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:23.157132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:23.167331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:23.169015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6aaf62-b2fd-4ba0-96c2-ba74bf91e7c9 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:23.179375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 932/1867] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:23.326114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:23.411113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b8926-a79c-4396-a13e-8c60ce310c77 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:23.416429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:23.417388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:23.417797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:23.419328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] PATH_INFO: `/v3/users/4c8f0c08d43245bfbf8ab67b11f2f223` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:23.420375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8f0c08d43245bfbf8ab67b11f2f223)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:23.423898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:23.522554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:23.690742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8f0c08d43245bfbf8ab67b11f2f223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:23.691540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8f0c08d43245bfbf8ab67b11f2f223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:23.692192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8f0c08d43245bfbf8ab67b11f2f223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:23.700859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8f0c08d43245bfbf8ab67b11f2f223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:23.809801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:23.812346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8f0c08d43245bfbf8ab67b11f2f223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:23.836963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 936/1868] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:23 2022] DELETE /identity/v3/users/4c8f0c08d43245bfbf8ab67b11f2f223 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:23.843915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:23.843915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:23.843915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:23.865130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:23.866496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:23.984062 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 933/1869] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:24.001669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:24.005251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:24.101641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e390-b48c-41c2-9a60-417f80c96ad0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:24.108301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:24.109706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:24.110350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:24.110975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:24.140505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:24.154582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:24.177404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 937/1870] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:24.282684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:24.741995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:24.744456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:24.765178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05618c7-9f7b-4c3d-a557-4d1bc6641400 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:24.771496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:24.772149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:24.772479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:24.772758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] PATH_INFO: `/v3/projects/caed193b6b11467bb4a29799921a518b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:24.773964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caed193b6b11467bb4a29799921a518b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:24.778545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:24.927588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caed193b6b11467bb4a29799921a518b', 'request_id': 'req-9d211aac-3bb5-4f23-938b-45b877dbd9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:24.928377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caed193b6b11467bb4a29799921a518b', 'request_id': 'req-9d211aac-3bb5-4f23-938b-45b877dbd9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:24.983540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caed193b6b11467bb4a29799921a518b', 'request_id': 'req-9d211aac-3bb5-4f23-938b-45b877dbd9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:24.994320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:24.996151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] The token cache is being invalidate because project caed193b6b11467bb4a29799921a518b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:24.996443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:24.996539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:24.997099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:24.998600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 934/1871] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:24 2022] DELETE /identity/v3/projects/caed193b6b11467bb4a29799921a518b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:25.000693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:25.002694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:25.004117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:25.074682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10474-3e89-43a9-ab9a-e55d450e847d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:25.074801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d211aac-3bb5-4f23-938b-45b877dbd9c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:25.080040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:25.080804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:25.081091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:25.081399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] PATH_INFO: `/v3/users/cd8b4d8164534507ac7b946ff81e1463` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:25.082620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8b4d8164534507ac7b946ff81e1463)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:25.084679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:25.131399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:25.132014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:25.132292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:25.132563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:25.134329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:25.185536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:25.205155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:25.206592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:25.217141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 938/1872] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:25.262434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8b4d8164534507ac7b946ff81e1463'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:25.263227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8b4d8164534507ac7b946ff81e1463'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:25.263887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8b4d8164534507ac7b946ff81e1463'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:25.272387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8b4d8164534507ac7b946ff81e1463'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:25.284904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36842cf2-5dcc-47e5-a1d0-ebf3ec6f3a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8b4d8164534507ac7b946ff81e1463'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:25.384661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 935/1873] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:25 2022] DELETE /identity/v3/users/cd8b4d8164534507ac7b946ff81e1463 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:25.951266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:25.958418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:25.964995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e4656-96b7-4b04-b184-b82ca9a6212d service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.031517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.032169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.032437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.032716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] PATH_INFO: `/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.033980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a09185b0fa4b648a45d3a1bf0119ea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.035953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.168048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a09185b0fa4b648a45d3a1bf0119ea', 'request_id': 'req-f97e3019-d29b-4a00-b4e7-b690a7dd8778'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:26.174526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a09185b0fa4b648a45d3a1bf0119ea', 'request_id': 'req-f97e3019-d29b-4a00-b4e7-b690a7dd8778'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:26.181246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a09185b0fa4b648a45d3a1bf0119ea', 'request_id': 'req-f97e3019-d29b-4a00-b4e7-b690a7dd8778'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:26.245836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] The token cache is being invalidate because project 53a09185b0fa4b648a45d3a1bf0119ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:26.246151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:26.246869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f97e3019-d29b-4a00-b4e7-b690a7dd8778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:26.248622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 939/1874] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:25 2022] DELETE /identity/v3/projects/53a09185b0fa4b648a45d3a1bf0119ea => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:26.258494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.258494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.258494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.274268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:26.275630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:26.327124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:26.340417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 936/1875] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:26.348070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.348359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.348637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.369166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:26.370660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:26.379022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 940/1876] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:26.383421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.393989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da74fd-5d89-4beb-881b-58f233d41a3c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.399866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.400312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.400597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.401412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.402145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:26.402455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.404086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.416721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 937/1877] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:26.422106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.432233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06910f-5fec-4267-8823-39d9b231fda2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.436989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.437677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.437962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.438241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.438921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.440862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.447330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:26.546624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 941/1878] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:26 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:26.551049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.562064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa8ce-3470-47ad-8c66-49d67faba130 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.633588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.634032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.634313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.634735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.635954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.638144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.795320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.796519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 938/1879] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:26 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:26.806317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032877e-d880-4ff4-8679-7534915af6a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.812102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.812718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.813077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.813280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.813931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.815577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.829175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 942/1880] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:26.831576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.841973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2f0d-a9b8-437f-80ae-f054f85be1bd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.847070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.847700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.847987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.848441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.848944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.850627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e4110-e20d-473d-80f9-66b09f49b786 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.864138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 939/1881] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:26.868672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:26.879676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7548b7-2d50-4176-8fa8-3dc82a10ae2f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:26.885319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:26.886177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:26.886566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:26.887698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] PATH_INFO: `/v3/projects/9530498332b140c99830d47e38b5022a/users/d4765dfdc53644d9911cb8b70adab6f5/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:26.903206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530498332b140c99830d47e38b5022a, user_id=d4765dfdc53644d9911cb8b70adab6f5, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:26.905901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:26.994331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 943/1882] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:26 2022] PUT /identity/v3/projects/9530498332b140c99830d47e38b5022a/users/d4765dfdc53644d9911cb8b70adab6f5/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:27.005595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.006082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.006171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.038917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] MFA Rules not processed for user `d4765dfdc53644d9911cb8b70adab6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:27.040428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:27.110255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 940/1883] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:27.115371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.184988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79fbb-a3d0-4d31-88b9-af340b800fb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.189774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.190397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.190683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.190960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.191629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.193629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.277728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 944/1884] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:27 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:27.282059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.294217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca89c3-2e8c-4bd1-adea-cf7556d956da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.353767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.359237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.359237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.359237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.359237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.359237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.418022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 941/1885] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:27 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:27.422261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.433208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683496-44eb-45cb-8a80-8eb8ea4c26d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.437942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.438809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.438945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.439664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.440320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.441954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.453759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 945/1886] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:27.458092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.469589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf1335-1dae-4a62-9a86-289d0743606c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.474551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.475328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.475607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.476235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] PATH_INFO: `/v3/projects/d17aa50803aa4c9a883c3004e4278646/users/2aa4c9e3b1ca459290974efa9e9d03b1/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.492884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17aa50803aa4c9a883c3004e4278646, user_id=2aa4c9e3b1ca459290974efa9e9d03b1, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.496353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.591405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 942/1887] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:27 2022] PUT /identity/v3/projects/d17aa50803aa4c9a883c3004e4278646/users/2aa4c9e3b1ca459290974efa9e9d03b1/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:27.595845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.606884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46924e2-505e-4860-9fb2-c7428b22bc35 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.662485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.662701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:27.663020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.663401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.663673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.664310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.665948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bc2b3-cd88-4c33-ab28-0347a7018023 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.676377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 946/1888] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:27.680599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.691243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50320daa-3089-4208-85b0-ddf20ad5df66 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.695991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.698685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.699166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.699400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] PATH_INFO: `/v3/projects/d17aa50803aa4c9a883c3004e4278646/users/2aa4c9e3b1ca459290974efa9e9d03b1/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.701466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17aa50803aa4c9a883c3004e4278646, user_id=2aa4c9e3b1ca459290974efa9e9d03b1, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.704211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.716112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 943/1889] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:27 2022] PUT /identity/v3/projects/d17aa50803aa4c9a883c3004e4278646/users/2aa4c9e3b1ca459290974efa9e9d03b1/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:27.727609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.727961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.728240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.760894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] MFA Rules not processed for user `2aa4c9e3b1ca459290974efa9e9d03b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:27.762458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:27.837593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 947/1890] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:27.848158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:27.850074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:27.851977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:27.917698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0421-0e50-4226-9b35-c39f131c0807 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:27.921520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:27.922143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:27.922419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:27.922690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:27.932812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:27.934452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:27.949491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 944/1891] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:28.154151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:28.166700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5781aa-8866-4856-97e0-4fc8cd5b0d6d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:28.172497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:28.173394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:28.173756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:28.174106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:28.243584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:28.245297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e0ed1-ca00-46a0-9a59-2f8f2367117f service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:28.254752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 948/1892] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:28.806342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:28.884282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10844-b3cc-4531-b0cc-6108b6d806c5 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:28.889590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:28.890236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:28.890592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:28.891052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] PATH_INFO: `/v3/users/d4765dfdc53644d9911cb8b70adab6f5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:28.892264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4765dfdc53644d9911cb8b70adab6f5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:28.894350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:28.946025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:28.961087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:29.105388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4765dfdc53644d9911cb8b70adab6f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:29.106512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4765dfdc53644d9911cb8b70adab6f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:29.107579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4765dfdc53644d9911cb8b70adab6f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:29.122287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4765dfdc53644d9911cb8b70adab6f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:29.140933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4765dfdc53644d9911cb8b70adab6f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:29.267818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 945/1893] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:28 2022] DELETE /identity/v3/users/d4765dfdc53644d9911cb8b70adab6f5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:29.272582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:29.273057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:29.273144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:29.294952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:29.296216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:29.367889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 949/1894] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:29.378187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:29.380010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:29.442496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0dafb-0247-4a7a-9c57-eb75d78b1c46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:29.446145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:29.446760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:29.447737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:29.447737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:29.459526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:29.461075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:29.473714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 946/1895] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:29.961933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:29.964697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:29.979317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae224b4-3370-4d16-8e41-4baf3a41b9a2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:29.985111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:29.985994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:29.986443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:29.986938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] PATH_INFO: `/v3/projects/9530498332b140c99830d47e38b5022a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:29.988362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530498332b140c99830d47e38b5022a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:29.990672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:30.104602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:30.106095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.118323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530498332b140c99830d47e38b5022a', 'request_id': 'req-2d869e1b-d7df-40a0-bebf-c131f7151ae3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.126149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592add-1a82-44ff-aacc-5915503adbea service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:30.127469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530498332b140c99830d47e38b5022a', 'request_id': 'req-2d869e1b-d7df-40a0-bebf-c131f7151ae3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.137429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530498332b140c99830d47e38b5022a', 'request_id': 'req-2d869e1b-d7df-40a0-bebf-c131f7151ae3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.210309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:30.210975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.211281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.211559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] PATH_INFO: `/v3/users/ffe7e84ea07843bb99d2cbd6afa54f42` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.212906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe7e84ea07843bb99d2cbd6afa54f42)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:30.214966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:30.242203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:30.248888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] The token cache is being invalidate because project 9530498332b140c99830d47e38b5022a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:30.249186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.250472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.252659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 950/1896] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:29 2022] DELETE /identity/v3/projects/9530498332b140c99830d47e38b5022a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:30.256794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:30.259366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.280266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869e1b-d7df-40a0-bebf-c131f7151ae3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:30.283154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:30.284186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.284608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.285048 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] PATH_INFO: `/v3/users/2aa4c9e3b1ca459290974efa9e9d03b1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.286603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa4c9e3b1ca459290974efa9e9d03b1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:30.290861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:30.499918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:30.505053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe7e84ea07843bb99d2cbd6afa54f42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.505796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe7e84ea07843bb99d2cbd6afa54f42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.506569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe7e84ea07843bb99d2cbd6afa54f42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.516400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe7e84ea07843bb99d2cbd6afa54f42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.528729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bef0ea81-2df9-4b24-a3bc-de334e5a5b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe7e84ea07843bb99d2cbd6afa54f42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.605501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa4c9e3b1ca459290974efa9e9d03b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.606279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa4c9e3b1ca459290974efa9e9d03b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.606903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa4c9e3b1ca459290974efa9e9d03b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.614376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa4c9e3b1ca459290974efa9e9d03b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.627202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 947/1897] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:30 2022] DELETE /identity/v3/users/ffe7e84ea07843bb99d2cbd6afa54f42 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:30.636742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5385de-909a-41b6-bf62-5d34cdc2f8d5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.637113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5385de-909a-41b6-bf62-5d34cdc2f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.637490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5385de-909a-41b6-bf62-5d34cdc2f8d5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.639569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 948/1898] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:45:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:45:30.640599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.640745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.640993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.670867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:30.672446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.710314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce297eca-72d2-49a8-997a-ad3189241109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa4c9e3b1ca459290974efa9e9d03b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:30.751384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 951/1899] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:30 2022] DELETE /identity/v3/users/2aa4c9e3b1ca459290974efa9e9d03b1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:30.751384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.751384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.751384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.781729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:30.783272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.786921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 949/1900] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:30.803797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:30.806107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.908885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 952/1901] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:45:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:30.913989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffcd55-1f75-48f3-b919-a9163f19ba6e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:30.923592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:30.925530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:30.939887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f438f0-69ff-482b-8261-47aa33168cb4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:30.946481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:30.947262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.947747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.948256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:30.957666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:30.959305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:30.969772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:30.970427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:30.970706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:30.970819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 953/1902] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:30.970975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:31.021411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:31.058077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:31.059786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:31.070877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 950/1903] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:31.523846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:31.526541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:31.541622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522bd2-5ba8-4fb0-a515-ae0d256bbede service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:31.546835 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:31.547533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:31.547819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:31.548106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] PATH_INFO: `/v3/projects/d17aa50803aa4c9a883c3004e4278646` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:31.549344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17aa50803aa4c9a883c3004e4278646)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:31.551394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:31.742422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:31.747489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17aa50803aa4c9a883c3004e4278646', 'request_id': 'req-a8646dd8-5d3e-44f3-9929-47e7c08f1094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:31.753730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17aa50803aa4c9a883c3004e4278646', 'request_id': 'req-a8646dd8-5d3e-44f3-9929-47e7c08f1094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:31.761015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17aa50803aa4c9a883c3004e4278646', 'request_id': 'req-a8646dd8-5d3e-44f3-9929-47e7c08f1094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:31.804049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:31.805686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:31.827884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f9bb-edb4-4985-87f6-99f0ca1aa0c2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:31.832245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] The token cache is being invalidate because project d17aa50803aa4c9a883c3004e4278646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:31.832653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:31.833564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8646dd8-5d3e-44f3-9929-47e7c08f1094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:31.835439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 954/1904] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:31 2022] DELETE /identity/v3/projects/d17aa50803aa4c9a883c3004e4278646 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:31.840135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec31eb-536e-459b-b4a1-2fbdcf9a8d5f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:31.840512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec31eb-536e-459b-b4a1-2fbdcf9a8d5f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:31.840792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec31eb-536e-459b-b4a1-2fbdcf9a8d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:31.870310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3bec31eb-536e-459b-b4a1-2fbdcf9a8d5f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:31.871832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3bec31eb-536e-459b-b4a1-2fbdcf9a8d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:31.899650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:31.900296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:31.900684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:31.901077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] PATH_INFO: `/v3/projects/5271919a9ec84880b385a0369e63bbac` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:31.902650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5271919a9ec84880b385a0369e63bbac)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:31.904622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:31.944642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 955/1905] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:45:31.952937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:31.953226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:31.953503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:31.974494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:31.975757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:31.985019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 956/1906] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:31.994206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.005027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574d194-b336-4ced-b671-7d9678b138eb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.010395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.011272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.011556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.011828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.012496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:32.012921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.014652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.040216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 957/1907] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:45:32.040420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5271919a9ec84880b385a0369e63bbac', 'request_id': 'req-896df21c-3926-44fb-b6c2-d2af43aa47f6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.042285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.052958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5271919a9ec84880b385a0369e63bbac', 'request_id': 'req-896df21c-3926-44fb-b6c2-d2af43aa47f6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.056174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c04c2-7ead-4df6-bb20-9f2107478b47 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.120307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.120956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.121240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.121516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.122148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.124124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.154866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5271919a9ec84880b385a0369e63bbac', 'request_id': 'req-896df21c-3926-44fb-b6c2-d2af43aa47f6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.167477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] The token cache is being invalidate because project 5271919a9ec84880b385a0369e63bbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:32.167798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.168469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.170360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 951/1908] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:31 2022] DELETE /identity/v3/projects/5271919a9ec84880b385a0369e63bbac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:32.174813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.176351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:32.189770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896df21c-3926-44fb-b6c2-d2af43aa47f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.194537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.195220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.195498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.195774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] PATH_INFO: `/v3/users/86f374d444094369b0bccb3c2a8d140a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.196957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f374d444094369b0bccb3c2a8d140a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.198982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.256577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 958/1909] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:32 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:45:32.261436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.263762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:32.331489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a5b6e-c8b9-4da3-bc6a-b9e7eaa1b56b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.339243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.339243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.339243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.339741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.340646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.343474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.488501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f374d444094369b0bccb3c2a8d140a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.488752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 959/1910] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:32 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:45:32.492894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f374d444094369b0bccb3c2a8d140a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.493511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.493634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f374d444094369b0bccb3c2a8d140a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.496536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:32.497427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:32.504667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f374d444094369b0bccb3c2a8d140a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.520416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f374d444094369b0bccb3c2a8d140a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:32.527765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907210d-0e51-4770-9c30-8909029f0d46 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.533293 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.533983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.534269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.534541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.536340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.537005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.549613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 960/1911] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:32.553849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.565880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335a62-3832-45b5-b7ff-65be858a0050 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.576904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.577542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.577823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.578099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.578747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.580475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0356-e367-4f68-979b-b1a4cc409a81 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.597522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 952/1912] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:32 2022] DELETE /identity/v3/users/86f374d444094369b0bccb3c2a8d140a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:45:32.601148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 961/1913] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:32.608751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.701814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d09ea-bec3-4834-a953-0b83c9072984 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:32.705637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:32.706320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.706605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.707026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] PATH_INFO: `/v3/projects/569f082eb5ea438984eef27d0009de9b/users/ef5522a613904d92bc17773397a75919/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.725973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=569f082eb5ea438984eef27d0009de9b, user_id=ef5522a613904d92bc17773397a75919, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:32.729243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:32.824073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 953/1914] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:32 2022] PUT /identity/v3/projects/569f082eb5ea438984eef27d0009de9b/users/ef5522a613904d92bc17773397a75919/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:32.834731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:32.834940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:32.835338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:32.865114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] MFA Rules not processed for user `ef5522a613904d92bc17773397a75919`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:32.866354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:32.950571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 962/1915] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:32.961109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:32.962832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:33.030224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228a95f-8cad-4530-bf7b-72b22a32c4ee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:33.035177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:33.035970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:33.036261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:33.036543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:33.053263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:33.057647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:33.065670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 954/1916] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:33.221426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:33.224895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:33.225769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:33.309198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9c101-1569-4cd8-b04e-a7095a7b8541 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:33.313951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:33.314601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:33.314891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:33.315197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] PATH_INFO: `/v3/projects/bf9b2a5399234adb99e9544267a1df48` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:33.316334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9b2a5399234adb99e9544267a1df48)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:33.318310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:33.492634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9b2a5399234adb99e9544267a1df48', 'request_id': 'req-56eccffa-7894-481f-8796-bbde0442cc68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.498272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9b2a5399234adb99e9544267a1df48', 'request_id': 'req-56eccffa-7894-481f-8796-bbde0442cc68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.504655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9b2a5399234adb99e9544267a1df48', 'request_id': 'req-56eccffa-7894-481f-8796-bbde0442cc68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.582709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] The token cache is being invalidate because project bf9b2a5399234adb99e9544267a1df48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:33.584136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.590154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.593298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 963/1917] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:33 2022] DELETE /identity/v3/projects/bf9b2a5399234adb99e9544267a1df48 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:33.596373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:33.612395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb6d6-bc22-4c27-8ab3-a4ed0ed788ad service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:33.690405 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:33.691537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:33.692029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:33.692814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] PATH_INFO: `/v3/users/ecb55f620de64d4bae2bf3b9049f74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:33.694252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb55f620de64d4bae2bf3b9049f74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:33.699625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:33.918149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb55f620de64d4bae2bf3b9049f74f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.921875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb55f620de64d4bae2bf3b9049f74f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.922577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb55f620de64d4bae2bf3b9049f74f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.930827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb55f620de64d4bae2bf3b9049f74f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:33.944710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73c27c83-9e61-4306-ad45-05c68bef44c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb55f620de64d4bae2bf3b9049f74f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:34.034853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 955/1918] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:33 2022] DELETE /identity/v3/users/ecb55f620de64d4bae2bf3b9049f74f0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:34.140775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:34.677505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:34.679362 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:34.694499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccffa-7894-481f-8796-bbde0442cc68 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:34.765602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:34.766258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:34.766543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:34.767032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] PATH_INFO: `/v3/projects/0c3558b76c66461f9b998354cf8fce2a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:34.768244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3558b76c66461f9b998354cf8fce2a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:34.770390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:34.806219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:34.960156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3558b76c66461f9b998354cf8fce2a', 'request_id': 'req-fa95c052-0e8b-462c-9999-d3d9fc1cae33'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:34.967163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3558b76c66461f9b998354cf8fce2a', 'request_id': 'req-fa95c052-0e8b-462c-9999-d3d9fc1cae33'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:34.973850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3558b76c66461f9b998354cf8fce2a', 'request_id': 'req-fa95c052-0e8b-462c-9999-d3d9fc1cae33'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:35.008289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271adfe-458c-44b1-af36-3283dbf19844 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.009270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271adfe-458c-44b1-af36-3283dbf19844 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.010081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271adfe-458c-44b1-af36-3283dbf19844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.034173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3271adfe-458c-44b1-af36-3283dbf19844 None None] MFA Rules not processed for user `ef5522a613904d92bc17773397a75919`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:35.035581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3271adfe-458c-44b1-af36-3283dbf19844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:35.085588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] The token cache is being invalidate because project 0c3558b76c66461f9b998354cf8fce2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:35.085875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:35.086524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fa95c052-0e8b-462c-9999-d3d9fc1cae33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:35.089815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 964/1919] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:34 2022] DELETE /identity/v3/projects/0c3558b76c66461f9b998354cf8fce2a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:35.095952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.096247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.096530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.115728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 956/1920] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:35.118917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:35.121534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:35.201060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 965/1921] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:35.209552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.209846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.210130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.237981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:35.239440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:35.248588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 957/1922] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:35.252858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.265618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad05bae-aaf5-432e-8f66-fc2120bef5be None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.272592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.273530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.273807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.274084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.274775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:35.275076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.277821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.293420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 966/1923] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:35.305468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.316349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf393-2391-4a32-9844-e5861d30f160 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.322016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.323265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.323534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.323973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.326382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.329605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.482865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:35.490675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 958/1924] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:35.494816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.506232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838695-1ad2-4f07-9170-0c3a09733f43 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.594934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.595797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.596105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.596385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.597199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.600000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.722374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 967/1925] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:45:35.727194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.742601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c872d-8db9-47c2-a1cf-e335914b559b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.749481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.750114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.750517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.750818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.752376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.753252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.770581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 959/1926] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:45:35.772189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.783662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c147-6545-4139-b48f-f3c88e061c7c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.792614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.793257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.793544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.793822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.794808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.796503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690087d-b62c-4597-8174-8b0921953d96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.814557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 968/1927] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:35.823365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:35.839751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617caa39-3d2b-4481-885a-dde84b903394 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:35.845706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:35.846503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.846795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.847072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] PATH_INFO: `/v3/projects/f85bb7baac0843d09c87458fb3c7ce55/users/55428e6dfda348f8940fa746a9fbf2b6/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:35.865585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85bb7baac0843d09c87458fb3c7ce55, user_id=55428e6dfda348f8940fa746a9fbf2b6, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:35.868482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:35.985600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 960/1928] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:35 2022] PUT /identity/v3/projects/f85bb7baac0843d09c87458fb3c7ce55/users/55428e6dfda348f8940fa746a9fbf2b6/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:35.997430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:35.997646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:35.997946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:36.068409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] MFA Rules not processed for user `55428e6dfda348f8940fa746a9fbf2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:36.079171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:36.205286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 969/1929] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:36.224960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:36.233439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:36.264831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:36.347012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91eef-f0fa-4f29-9108-01cb1c56baba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:36.352833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:36.359123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:36.359123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:36.359123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:36.365758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:36.368106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d867417-a35d-4b3c-94de-293d214ef6ff service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:36.379312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 961/1930] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:36.415396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:36.514159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:36.529691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76587-e2f9-43ea-b00a-3c944e4ba71e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:36.535497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:36.536245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:36.536531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:36.536806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] PATH_INFO: `/v3/users/55428e6dfda348f8940fa746a9fbf2b6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:36.538089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55428e6dfda348f8940fa746a9fbf2b6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:36.540086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:36.855998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55428e6dfda348f8940fa746a9fbf2b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:36.858248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55428e6dfda348f8940fa746a9fbf2b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:36.858935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55428e6dfda348f8940fa746a9fbf2b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:36.875618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55428e6dfda348f8940fa746a9fbf2b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:36.965759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55428e6dfda348f8940fa746a9fbf2b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:36.984740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 970/1931] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:36 2022] DELETE /identity/v3/users/55428e6dfda348f8940fa746a9fbf2b6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:36.989331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:36.989569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:36.989846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:37.011748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:37.013219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:37.082096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 962/1932] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:37.106544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:37.108015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:37.196339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71e03d-bb1e-4b72-a0c9-3f19c3baab66 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:37.201969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:37.204526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:37.204526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:37.204526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:37.214898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:37.216538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546cd5-f583-4969-99db-dd07e181ceec service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:37.228815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 971/1933] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:37.785267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:37.787441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:37.815358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558d6a7-8065-45e2-b8d5-8e6f6185abcb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:37.840128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:37.845037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:37.845037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:37.845037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] PATH_INFO: `/v3/projects/f85bb7baac0843d09c87458fb3c7ce55` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:37.845037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85bb7baac0843d09c87458fb3c7ce55)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:37.845037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:37.941653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85bb7baac0843d09c87458fb3c7ce55', 'request_id': 'req-447f81fd-7803-410e-aa6c-16c166b41aa8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:37.948933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85bb7baac0843d09c87458fb3c7ce55', 'request_id': 'req-447f81fd-7803-410e-aa6c-16c166b41aa8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:38.028803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85bb7baac0843d09c87458fb3c7ce55', 'request_id': 'req-447f81fd-7803-410e-aa6c-16c166b41aa8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:38.042711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] The token cache is being invalidate because project f85bb7baac0843d09c87458fb3c7ce55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:38.043198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:38.044486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-447f81fd-7803-410e-aa6c-16c166b41aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:38.046090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 963/1934] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:37 2022] DELETE /identity/v3/projects/f85bb7baac0843d09c87458fb3c7ce55 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:38.054561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118962c4-0b21-4168-b5ff-59758400193d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.055123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118962c4-0b21-4168-b5ff-59758400193d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.055268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118962c4-0b21-4168-b5ff-59758400193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.078127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-118962c4-0b21-4168-b5ff-59758400193d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:38.079662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-118962c4-0b21-4168-b5ff-59758400193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:38.189296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 972/1935] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:38.197421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.198650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.198950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.234511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:38.235984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:38.245767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 964/1936] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:38.251510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118962c4-0b21-4168-b5ff-59758400193d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.263341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118962c4-0b21-4168-b5ff-59758400193d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.269978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.270897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.271257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.271999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.272808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:38.273269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:38.276474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:38.288092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:38.299819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 973/1937] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:38.300598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.318482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6036-b5b7-42da-9f2f-c92baee4775a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.336333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.337162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.337456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.337889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.338723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:38.341017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:38.514546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 965/1938] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:38 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:45:38.516583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.528591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5487168-affa-48b7-93e5-3a0440a1db78 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.633495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.634308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.634854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.635813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.636684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:38.638958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:38.787799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 974/1939] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:38 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:38.794984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.823152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9022-865b-4d15-a2df-4139e7a9dae0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.845188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.846195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.846714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.852810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.854566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:38.863750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:38.872205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:38.878963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 966/1940] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:38.885410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.904545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f73fce-80c8-4774-bb2e-b817149cd633 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.913456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.914601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.915067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.915730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:38.916911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:38.919580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1b579-4289-488c-bf18-ec3b2d26e75c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:38.956934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 975/1941] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:38.958783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:38.971606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56351-a201-48b8-8adc-84799f28a440 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:38.977756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:38.978591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:38.978971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:38.979745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] PATH_INFO: `/v3/projects/83686037b3a7475fba193fa5249cd89e/users/c8d4267bdc8d4976b31747566cdcde1a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:39.003384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83686037b3a7475fba193fa5249cd89e, user_id=c8d4267bdc8d4976b31747566cdcde1a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:39.006830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:39.138234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 967/1942] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:38 2022] PUT /identity/v3/projects/83686037b3a7475fba193fa5249cd89e/users/c8d4267bdc8d4976b31747566cdcde1a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:39.140147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:39.140612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:39.140690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:39.190360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] MFA Rules not processed for user `c8d4267bdc8d4976b31747566cdcde1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:39.192496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:39.296945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 976/1943] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:39.314306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:39.317099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:39.441562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee3be0-6a2c-4210-88fb-50a71b72df5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:39.447901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:39.450294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:39.450294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:39.450294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:39.459789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:39.461395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0938f5-3ae2-462e-a91a-38f9bbaa3f9e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:39.473574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 968/1944] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:45:49.289624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:49.467232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:53.153162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:53.228092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05636309-4b33-4440-a8d5-c4fb74722a0b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:53.232861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:53.233881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:53.233881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:53.234199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] PATH_INFO: `/v3/users/c8d4267bdc8d4976b31747566cdcde1a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:53.235569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d4267bdc8d4976b31747566cdcde1a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:53.237753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:53.408964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d4267bdc8d4976b31747566cdcde1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:53.409639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d4267bdc8d4976b31747566cdcde1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:53.410392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d4267bdc8d4976b31747566cdcde1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:53.418304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d4267bdc8d4976b31747566cdcde1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:53.468365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d4267bdc8d4976b31747566cdcde1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:53.488302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 977/1945] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:45:53 2022] DELETE /identity/v3/users/c8d4267bdc8d4976b31747566cdcde1a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:53.492799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:53.493806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:53.493975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:53.513227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:53.514433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:53.573527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 969/1946] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:53.583556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:53.585573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:53.643239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070233e8-40b8-4b70-8d4d-a4d32c9cc49e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:53.646851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:53.647494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:53.647779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:53.648059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:53.657522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:53.658975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0763e17-b54e-4811-b49b-cfee0e42aaa9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:53.669662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 978/1947] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:45:54.149202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.151344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:54.163888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f047e7-babe-4766-b5aa-802d6d5caac5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.169573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.170226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.170510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.170789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] PATH_INFO: `/v3/projects/83686037b3a7475fba193fa5249cd89e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.171999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83686037b3a7475fba193fa5249cd89e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.173934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.284393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83686037b3a7475fba193fa5249cd89e', 'request_id': 'req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:54.290327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83686037b3a7475fba193fa5249cd89e', 'request_id': 'req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:54.362067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83686037b3a7475fba193fa5249cd89e', 'request_id': 'req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:54.374303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] The token cache is being invalidate because project 83686037b3a7475fba193fa5249cd89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:45:54.374593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:54.375283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68b91d0b-b22f-4e4e-8336-fa650c9dbd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:45:54.377117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 970/1948] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:45:54 2022] DELETE /identity/v3/projects/83686037b3a7475fba193fa5249cd89e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:54.381753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.382250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.382335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.404475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:54.405686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:54.424473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:54.467999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 979/1949] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:54.477139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.477527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.478029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.498171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:54.500080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:54.509539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 971/1950] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:54.513975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.524275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70907fd-96fc-4102-95e5-e1413dcdc1f5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.529734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.530277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.530555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.530825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.531499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:45:54.531798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.533385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.546457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 980/1951] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:45:54.550946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.560717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd508b-25b0-41f9-b2a7-1a1901df7c4c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.565491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.566129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.566482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.566682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.567339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.569301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.687269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 972/1952] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:45:54 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:54.691627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.703432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce648b4-debb-4009-a91d-63c9b576ff3e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.761996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.762607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.762890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.763200 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.763845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.765772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.845580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 981/1953] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:45:54 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:45:54.849714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.860587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0549-9a80-4672-802a-2e10ea2fd181 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.865483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.866092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.870722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.870722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.870722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.870722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.879545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 973/1954] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:54.883522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.894549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45d745-47f5-49c6-b4bc-b603311df804 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.899220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.900104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.900489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.900768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.901406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.903298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a19df-9565-4c21-b3c6-abec921107f4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:54.918717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 982/1955] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:45:54.920455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:54.930593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df750ef5-1e72-49e9-936d-5642b6373101 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:54.936039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:54.936691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:54.936975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:54.937251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] PATH_INFO: `/v3/projects/db2c4f9658414e08b148ced4d0cdc262/users/bf26a564a49b408ba2ef919699b41a9b/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:54.952911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2c4f9658414e08b148ced4d0cdc262, user_id=bf26a564a49b408ba2ef919699b41a9b, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:54.955628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:55.034036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 974/1956] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:45:54 2022] PUT /identity/v3/projects/db2c4f9658414e08b148ced4d0cdc262/users/bf26a564a49b408ba2ef919699b41a9b/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:45:55.044962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:55.045250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:55.045526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:55.076157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] MFA Rules not processed for user `bf26a564a49b408ba2ef919699b41a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:45:55.077385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:55.147751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 983/1957] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:45:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:45:55.158969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:45:55.162888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:45:55.188251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:55.234013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91aa86-a94e-4c9c-a67b-08c9243f13e5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:45:55.238569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:45:55.239456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:45:55.239895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:45:55.240308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:45:55.250480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:45:55.252178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9f00-799a-4c41-9579-c4f8b6a87efe service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:45:55.263148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 975/1958] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:45:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:05.143995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:05.337173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=17 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:06.896868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:07.019007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f276b-de21-440e-bc5a-29d4c88a3b34 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:07.026436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:07.027208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:07.027494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:07.027940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] PATH_INFO: `/v3/users/bf26a564a49b408ba2ef919699b41a9b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:07.029843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf26a564a49b408ba2ef919699b41a9b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:07.032806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:07.237530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf26a564a49b408ba2ef919699b41a9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:07.238700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf26a564a49b408ba2ef919699b41a9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:07.240365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf26a564a49b408ba2ef919699b41a9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:07.250600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf26a564a49b408ba2ef919699b41a9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:07.315578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf26a564a49b408ba2ef919699b41a9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:07.338989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 984/1959] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:06 2022] DELETE /identity/v3/users/bf26a564a49b408ba2ef919699b41a9b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:07.343446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:07.343896 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:07.343982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:07.364701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:07.366111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:07.466419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 976/1960] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:07.479457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:07.481035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:07.619325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c053b17-9a82-46d8-b39e-928c1fc05585 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:07.641093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:07.641893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:07.642286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:07.643537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:07.649004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:07.650844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:07.659398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:07.665727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:07.678754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 985/1961] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:07.737368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ccb3b-1179-4bb2-89b0-e2365304643c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:07.737928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:07.738563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:07.738846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:07.739298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:07.741436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:07.854539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:07.856089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674aad8-0cca-41be-b1ab-c07a5e1d87f3 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:07.875909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 977/1962] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:46:08.224566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:08.226093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:08.247905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635cc44-8df2-4089-aad2-3e26dc55978d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:08.253858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:08.253858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:08.253858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:08.253858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] PATH_INFO: `/v3/projects/db2c4f9658414e08b148ced4d0cdc262` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:08.255219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2c4f9658414e08b148ced4d0cdc262)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:08.257165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:08.301105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:08.405528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2c4f9658414e08b148ced4d0cdc262', 'request_id': 'req-611fba33-e950-49dc-87f9-c42b2b59d99e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:08.411849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2c4f9658414e08b148ced4d0cdc262', 'request_id': 'req-611fba33-e950-49dc-87f9-c42b2b59d99e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:08.419294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2c4f9658414e08b148ced4d0cdc262', 'request_id': 'req-611fba33-e950-49dc-87f9-c42b2b59d99e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:08.508391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] The token cache is being invalidate because project db2c4f9658414e08b148ced4d0cdc262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:08.508391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:08.508391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-611fba33-e950-49dc-87f9-c42b2b59d99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:08.533679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 986/1963] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:08 2022] DELETE /identity/v3/projects/db2c4f9658414e08b148ced4d0cdc262 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:09.500488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:09.501006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:09.501268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:09.502713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 978/1964] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:46:09.509220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:09.509720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:09.509929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:09.530865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:09.532156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:09.611653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 987/1965] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:46:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:09.624081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:09.625816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:09.643037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad98020-2216-4cb2-b7bf-b11c76e10349 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:09.648213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:09.648845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:09.649223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:09.649514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:09.658980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:09.660643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:09.673142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 979/1966] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:09.690741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:09.692432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:09.774445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5c02-63ff-4b04-ba03-acf0d3e2ba4d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:09.779581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:09.780216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:09.780495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:09.780769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] PATH_INFO: `/v3/users/37bd85f0c7174b2785b1e7bc2d1f489b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:09.781974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bd85f0c7174b2785b1e7bc2d1f489b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:09.783857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:09.970962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:09.973491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bd85f0c7174b2785b1e7bc2d1f489b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:09.974133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bd85f0c7174b2785b1e7bc2d1f489b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:09.974790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bd85f0c7174b2785b1e7bc2d1f489b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:09.982203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bd85f0c7174b2785b1e7bc2d1f489b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.084113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-245b057c-476b-40be-a1f1-fe9c5bb9daa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bd85f0c7174b2785b1e7bc2d1f489b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.103231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 988/1967] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:09 2022] DELETE /identity/v3/users/37bd85f0c7174b2785b1e7bc2d1f489b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:10.343106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:10.354210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b700-5161-417d-ac77-ae4bee63e2f5 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:10.389451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:10.412802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:10.413436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.413767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.414057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] PATH_INFO: `/v3/projects/6ac9dce37e3641c9b78c746fa8dcd1be` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.416192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac9dce37e3641c9b78c746fa8dcd1be)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:10.418105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:10.528038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac9dce37e3641c9b78c746fa8dcd1be', 'request_id': 'req-679e0c4f-0361-4936-9b03-a81730a5547a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.534101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac9dce37e3641c9b78c746fa8dcd1be', 'request_id': 'req-679e0c4f-0361-4936-9b03-a81730a5547a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.634775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac9dce37e3641c9b78c746fa8dcd1be', 'request_id': 'req-679e0c4f-0361-4936-9b03-a81730a5547a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.635715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] The token cache is being invalidate because project 6ac9dce37e3641c9b78c746fa8dcd1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:10.636075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.636798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-679e0c4f-0361-4936-9b03-a81730a5547a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:10.638382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 980/1968] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:10 2022] DELETE /identity/v3/projects/6ac9dce37e3641c9b78c746fa8dcd1be => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:10.643756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.644226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.644346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.665698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:10.666905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:10.726315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 989/1969] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:10.734759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.735054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.735366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.755131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:10.756340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:10.764362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 981/1970] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:10.768611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:10.779006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41dbe6-0acf-47a3-962a-0a8bb4b0943f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:10.784120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:10.784816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.785099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.785431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.786180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:46:10.786492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:10.788169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:10.801266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 990/1971] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:46:10.806049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:10.815735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6f6af-35f0-4308-8876-3a1dff37f82e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:10.820408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:10.821516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.822002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.822415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.823057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:10.825284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:10.916144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 982/1972] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:10 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:46:10.920633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:10.931031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c85f-9f4c-421b-95a0-75d56072ff55 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:10.990081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:10.990696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:10.990977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:10.991281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:10.991921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:10.994109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.074917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 991/1973] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:10 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:11.079304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.090578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e658eba-f079-48fe-9808-5340e0ec44c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.095517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.096124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.096411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.096685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.097332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.098964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.109246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 983/1974] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:11.113367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.123805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa7d0-d0c1-4a72-bbb1-ce3bb07823e0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.128456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.129059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.129342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.129616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.130255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.131899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa544bd-94e5-42e7-8525-f5ee3142bf9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.143223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 992/1975] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:11.147460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.158279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89017884-1985-4ea7-b123-24254733d5c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.163052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.163726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.164008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.164285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] PATH_INFO: `/v3/projects/c63defc6b8794b4b97f60221d64262dd/users/efad30f05e724f8b8e21ba599be8d4cb/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.179237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63defc6b8794b4b97f60221d64262dd, user_id=efad30f05e724f8b8e21ba599be8d4cb, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.181921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.233919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 984/1976] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:11 2022] PUT /identity/v3/projects/c63defc6b8794b4b97f60221d64262dd/users/efad30f05e724f8b8e21ba599be8d4cb/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:11.244979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.245266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.245574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.273061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] MFA Rules not processed for user `efad30f05e724f8b8e21ba599be8d4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:11.274377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:11.286876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:11.338159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 993/1977] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:11.342802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.404309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b576ab-c657-46ee-80bb-eb06e1c7388a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.409000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.409567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.409849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.410125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.410746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.412690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.422326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:11.498480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 985/1978] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:11 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:11.502633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.513997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a617e-cddb-47b3-a701-dd05d0c3a3c3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.570334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.571763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.572275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.572575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.573203 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.575142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.655888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 994/1979] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:11 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:11.660352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.672026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c176ea-0a0b-4a64-90f9-8f89f51c7804 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.676817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.677424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.677705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.677982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.678635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.680840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.691609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 986/1980] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:11.695759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.706104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715323-f3c5-4104-ad83-2480a9baa565 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.710943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.711763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.712150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.712531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] PATH_INFO: `/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8/users/5a972e90de9340cf8edef2d119a89da5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.730959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e54c5392b93497a8f3ddcac4b4be6e8, user_id=5a972e90de9340cf8edef2d119a89da5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.733997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.821830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 995/1981] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:11 2022] PUT /identity/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8/users/5a972e90de9340cf8edef2d119a89da5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:11.825899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.836915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcc67-eb25-4522-800e-bb45f735c7f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.897555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.898077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.898369 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.898662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.899458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.901120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b636-9a1a-4a83-8a9e-effb1e05f3d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.915421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 987/1982] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:11.916308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:11.936866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791c91-8422-414f-9d98-6774a9ed5491 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:11.941925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:11.942776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.943300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.943579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] PATH_INFO: `/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8/users/5a972e90de9340cf8edef2d119a89da5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:11.945539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e54c5392b93497a8f3ddcac4b4be6e8, user_id=5a972e90de9340cf8edef2d119a89da5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:11.948811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:11.960576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 996/1983] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:11 2022] PUT /identity/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8/users/5a972e90de9340cf8edef2d119a89da5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:11.973699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:11.973990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:11.974270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:12.006961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] MFA Rules not processed for user `5a972e90de9340cf8edef2d119a89da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:12.008357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:12.101940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 988/1984] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:12.115670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:12.118586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:12.182285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1a9c-b4bb-46b0-b5b9-f4722a574106 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:12.185911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:12.186522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:12.186804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:12.187095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:12.197453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:12.198929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e89cd8-265a-4613-8732-7c137eccd436 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:12.208732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 997/1985] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:12.437722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:12.447991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e83b-f8dd-4ce1-b368-fdf0c9a1432a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:12.451712 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:12.452426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:12.452776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:12.453122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:12.514756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:12.516418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:12.520028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:12.528842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 989/1986] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:16.004631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959f66-ad27-42dc-be37-541116a7d9d2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:16.005123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959f66-ad27-42dc-be37-541116a7d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:16.005214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959f66-ad27-42dc-be37-541116a7d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:16.025930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cc959f66-ad27-42dc-be37-541116a7d9d2 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:16.027214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc959f66-ad27-42dc-be37-541116a7d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:16.032923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:16.086434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 998/1987] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:46:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:16.134714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:16.134714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:16.203887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b3a5d-7646-4659-8d91-bc088c892bbd service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:16.209277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:16.209879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:16.210199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:16.210473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:16.218993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:16.220625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:16.229608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 990/1988] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:17.119824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86aab-77ba-4ba2-a649-a2a5e9918ee8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:17.120373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86aab-77ba-4ba2-a649-a2a5e9918ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:17.120814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86aab-77ba-4ba2-a649-a2a5e9918ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:17.141127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b3e86aab-77ba-4ba2-a649-a2a5e9918ee8 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:17.142323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b3e86aab-77ba-4ba2-a649-a2a5e9918ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:17.150036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 999/1989] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:17.162581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:17.174251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a052-ac8b-4e9d-9188-85eb7efd385e service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:17.179353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:17.179919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:17.181050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:17.181525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:17.189542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:17.191140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:17.199842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 991/1990] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:17.920557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5b9f-5120-49f9-a2b5-d1dca472cebb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:17.921002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5b9f-5120-49f9-a2b5-d1dca472cebb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:17.921462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5b9f-5120-49f9-a2b5-d1dca472cebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:17.942258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-86df5b9f-5120-49f9-a2b5-d1dca472cebb None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:17.943581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-86df5b9f-5120-49f9-a2b5-d1dca472cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:17.953289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1000/1991] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:17.967028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:17.977841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce3f0-f0a9-4362-b194-92523bb003fe service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:17.983359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:17.984073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:17.984424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:17.984779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:17.994870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:18.001213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:18.010240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 992/1992] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:18.564539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:18.564996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:18.565081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:18.586698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:18.588652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:18.596036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1001/1993] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:18.609537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:18.620571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23abd4-c952-4167-9951-92a5d77db2bb service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:18.625987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:18.626590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:18.626873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:18.627184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:18.635605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:18.637189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:18.645924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 993/1994] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:46:21.890597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:21.892214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:21.923769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:21.968460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c55fc-4917-4610-b8e6-f1ea576cfb78 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:21.973065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:21.973708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:21.973990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:21.974261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] PATH_INFO: `/v3/users/ef5522a613904d92bc17773397a75919` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:21.975466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5522a613904d92bc17773397a75919)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:21.977394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:21.992582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290aafa-f877-4e1b-aab2-27ffd592300d service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:21.998635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:21.999340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:21.999625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:21.999900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] PATH_INFO: `/v3/users/efad30f05e724f8b8e21ba599be8d4cb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.001022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efad30f05e724f8b8e21ba599be8d4cb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:22.002979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:22.168343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5522a613904d92bc17773397a75919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.169346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5522a613904d92bc17773397a75919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.169981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5522a613904d92bc17773397a75919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.177219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5522a613904d92bc17773397a75919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.195776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efad30f05e724f8b8e21ba599be8d4cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.196416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efad30f05e724f8b8e21ba599be8d4cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.197239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efad30f05e724f8b8e21ba599be8d4cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.199450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:22.204650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efad30f05e724f8b8e21ba599be8d4cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.216421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26a1eaa4-37c9-4c13-83f8-8efcc650c67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efad30f05e724f8b8e21ba599be8d4cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.261828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b40de70-472e-473c-b5f7-a6f137067e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5522a613904d92bc17773397a75919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:22.280625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1002/1995] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:21 2022] DELETE /identity/v3/users/ef5522a613904d92bc17773397a75919 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:22.284981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:22.285263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:22.285535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.305195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:22.307216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:22.316939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:22.318460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 994/1996] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:21 2022] DELETE /identity/v3/users/efad30f05e724f8b8e21ba599be8d4cb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:22.323378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:22.335665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:22.335665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.344425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:22.345681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:22.370616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1003/1997] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:22.380715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:22.382150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:22.407456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 995/1998] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:22.417721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:22.421464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:22.443950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f252e-6655-4cbc-8ec5-e61a493d04c0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:22.485676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965db88a-505c-4e68-b0a1-9b2c1114ad7c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:22.489440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:22.490163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:22.490546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:22.491050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.501132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:22.501259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:22.501806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:22.502076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:22.502347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.502887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:22.512854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:22.514300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:22.514796 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 996/1999] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:46:22.528223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1004/2000] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:46:22.845285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:22.847895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:22.872933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33855d-a42f-41e2-a2cb-44d1d62b0afc service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:22.883145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:22.883861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:22.884886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:22.885321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] PATH_INFO: `/v3/projects/569f082eb5ea438984eef27d0009de9b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:22.887294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569f082eb5ea438984eef27d0009de9b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:22.889752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.090386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569f082eb5ea438984eef27d0009de9b', 'request_id': 'req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.098688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569f082eb5ea438984eef27d0009de9b', 'request_id': 'req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.176235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.176235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.196547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569f082eb5ea438984eef27d0009de9b', 'request_id': 'req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.198013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:23.198159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de482-3f96-4f41-be70-507abcf0e6b7 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.210968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] The token cache is being invalidate because project 569f082eb5ea438984eef27d0009de9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:23.211226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.211984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ee37b9d-4f9d-4556-b3d7-ebfba406de17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.214116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 997/2001] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:22 2022] DELETE /identity/v3/projects/569f082eb5ea438984eef27d0009de9b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:23.219412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460f7e-1056-44cf-8390-540a80336982 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.219670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460f7e-1056-44cf-8390-540a80336982 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.219949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460f7e-1056-44cf-8390-540a80336982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.241690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7e460f7e-1056-44cf-8390-540a80336982 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:23.242965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e460f7e-1056-44cf-8390-540a80336982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.264165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.264810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.265119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.265398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] PATH_INFO: `/v3/projects/c63defc6b8794b4b97f60221d64262dd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.266543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63defc6b8794b4b97f60221d64262dd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.268728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.287944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:23.307166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 998/2002] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:23.315999 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.316292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.316572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.338408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:23.339684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.351377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 999/2003] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:23.356615 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.366285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc0306-13bd-414d-a7e1-cb56e7a6c469 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.371331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.371934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.372213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.372487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.373167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:46:23.373469 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.375218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.388415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1000/2004] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:46:23.394596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.402246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63defc6b8794b4b97f60221d64262dd', 'request_id': 'req-dad26391-e2a2-4f69-8fce-dcf460248e01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.405328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e4a2-ba8c-4599-a76c-1dd67918afb4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.410404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63defc6b8794b4b97f60221d64262dd', 'request_id': 'req-dad26391-e2a2-4f69-8fce-dcf460248e01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.419004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63defc6b8794b4b97f60221d64262dd', 'request_id': 'req-dad26391-e2a2-4f69-8fce-dcf460248e01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.471253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.472241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.472710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.473168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.473961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.476813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.496579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] The token cache is being invalidate because project c63defc6b8794b4b97f60221d64262dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:23.500707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.500707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.500707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1005/2005] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:23 2022] DELETE /identity/v3/projects/c63defc6b8794b4b97f60221d64262dd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:23.503262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.504631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.519130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad26391-e2a2-4f69-8fce-dcf460248e01 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.525602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.525602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.525602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.526123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] PATH_INFO: `/v3/users/5a972e90de9340cf8edef2d119a89da5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.527589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a972e90de9340cf8edef2d119a89da5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.529709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.582000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1001/2006] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:23 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:23.586883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.589480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.656422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add254-5754-4401-bf3b-843d64bbda87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.661270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.663691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.663691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.663691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.663691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.665114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.673590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:23.687650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a972e90de9340cf8edef2d119a89da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.688329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a972e90de9340cf8edef2d119a89da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.689097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a972e90de9340cf8edef2d119a89da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.696382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a972e90de9340cf8edef2d119a89da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.782130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a972e90de9340cf8edef2d119a89da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:23.788390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1002/2007] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:23 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:46:23.793847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.795524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:23.807636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1006/2008] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:23 2022] DELETE /identity/v3/users/5a972e90de9340cf8edef2d119a89da5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:23.809300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada399ff-1f98-496b-b036-564b1ccca0dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.876442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.877409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.877696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.878132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.878809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.880578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.892271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1003/2009] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:46:23.896181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.908674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa6a5-2475-4a6b-8a80-7a0cb0598d34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.913617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.914246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.914525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.914795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.916075 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.918640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba19479-5688-4bc7-a7cb-c1463dd1d232 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:23.929430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1007/2010] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:23.934467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:23.944872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb808-e682-43ee-9044-c9027db7eaf6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:23.949914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:23.950585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:23.950868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:23.951202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] PATH_INFO: `/v3/projects/5ce62c3379954a94b2a1db21132ae345/users/1eb44761a61846d79ea34e6d9b97ac9a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:23.968799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce62c3379954a94b2a1db21132ae345, user_id=1eb44761a61846d79ea34e6d9b97ac9a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:23.971657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:24.040570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1004/2011] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:23 2022] PUT /identity/v3/projects/5ce62c3379954a94b2a1db21132ae345/users/1eb44761a61846d79ea34e6d9b97ac9a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:24.047132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.047559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.048031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.072406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:24.074023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:24.159069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1008/2012] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:24.172898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:24.179097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:24.260124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98103-11fd-4a19-bf1a-aad2706942ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:24.263987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:24.264611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.264893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.265174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.279560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:24.279818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:24.280236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5ac3f-aac5-41da-8ff4-4384ab748537 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:24.280323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:24.291352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1005/2013] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:24.296502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f6bd3-7530-4b98-b7ab-445b26abdc4f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:24.302673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:24.303533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.303890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.304289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] PATH_INFO: `/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.308056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e54c5392b93497a8f3ddcac4b4be6e8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:24.311692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:24.315391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:24.486634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e54c5392b93497a8f3ddcac4b4be6e8', 'request_id': 'req-436fda2d-918e-4c37-8743-1286c02188e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:24.492615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e54c5392b93497a8f3ddcac4b4be6e8', 'request_id': 'req-436fda2d-918e-4c37-8743-1286c02188e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:24.499514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e54c5392b93497a8f3ddcac4b4be6e8', 'request_id': 'req-436fda2d-918e-4c37-8743-1286c02188e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:24.616316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] The token cache is being invalidate because project 1e54c5392b93497a8f3ddcac4b4be6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:24.616612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:24.617446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-436fda2d-918e-4c37-8743-1286c02188e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:24.619926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1009/2014] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:24 2022] DELETE /identity/v3/projects/1e54c5392b93497a8f3ddcac4b4be6e8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:24.625102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.625389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.625694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.646434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:24.647691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:24.714718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1006/2015] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:24.722776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.723067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.723472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.764959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:24.766263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:24.775561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1010/2016] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:24.780268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:24.786175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:24.790968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6a60-5acc-4e88-9f3f-f4a222138b31 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:24.795960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:24.796604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.796888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.797166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.797866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:46:24.798171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:24.799833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:24.812224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1007/2017] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:46:24.816593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:24.826241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ba659-1956-4ef1-81b0-48b8dd756831 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:24.831147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:24.831760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:24.832034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:24.832305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:24.832997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:24.834926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:24.998093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1011/2018] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:24 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:46:25.002501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.013452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f38e8-763a-47ac-bbe1-ff8a6fcad3ef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.069611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.070220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.070500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.070772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.071423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.074168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.147954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1008/2019] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:25 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:25.153018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.163536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8a6b-ab66-48a5-a252-732c34192c40 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.168574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.169254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.169838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.170344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.171535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.173223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.184134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1012/2020] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:25.194071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.205504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3297-1848-4e99-a34d-1b99741b5a4e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.210746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.211744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.212100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.213133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.214047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.216433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768d49-f64e-49f7-b365-81605c76979c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.231475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1009/2021] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:25.232619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.242596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2765e-e601-4b54-b5b0-c9cd431b8c2d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.247621 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.248316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.248597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.254271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] PATH_INFO: `/v3/projects/5b7781ecaf6c4b51838a2c76d3ecce41/users/0f1a1d0e13ba472ba54bd6a7671b5c09/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.264399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7781ecaf6c4b51838a2c76d3ecce41, user_id=0f1a1d0e13ba472ba54bd6a7671b5c09, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.267124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.336120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1013/2022] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:25 2022] PUT /identity/v3/projects/5b7781ecaf6c4b51838a2c76d3ecce41/users/0f1a1d0e13ba472ba54bd6a7671b5c09/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:25.347412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.347699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.347975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.379363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] MFA Rules not processed for user `0f1a1d0e13ba472ba54bd6a7671b5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:25.380475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:25.458984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1010/2023] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:25.464402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.550569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ebb03-21c2-45e6-b4ce-0e2629e22923 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.557912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.558620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.559016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.559477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.560165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.562519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.709409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1014/2024] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:25 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:46:25.714190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.729650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919ca23-a831-4cf3-a967-e3f77c2eb092 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.798377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.799013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.799391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.799761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.800417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.802447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.824968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:25.954453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1011/2025] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:25 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:25.959659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:25.972214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8226-b770-4963-90c2-d4d511850d0d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:25.976958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:25.977600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:25.977907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:25.978181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:25.978831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:25.980514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:25.986651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:25.994766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1015/2026] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:26.004302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:26.015452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d9cf-577a-4a09-81d2-120308d2e64c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:26.020955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:26.021632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:26.021933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:26.022206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] PATH_INFO: `/v3/projects/8772630208de40308c4e365e2babd525/users/88bbe91c61c74cb09e653843524dcf0e/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:26.045259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8772630208de40308c4e365e2babd525, user_id=88bbe91c61c74cb09e653843524dcf0e, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:26.048223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:26.160125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1012/2027] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:26 2022] PUT /identity/v3/projects/8772630208de40308c4e365e2babd525/users/88bbe91c61c74cb09e653843524dcf0e/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:26.165853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:26.179856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a3c4-e050-455e-af8e-a112e362ddb8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:26.243300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:26.244717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:26.245285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:26.245568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:26.246219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:26.247900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a0d6-5ece-4e23-9bd7-6874e1635119 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:26.261994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1016/2028] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:26.263492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:26.273891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e562-8a5e-480d-8cdc-facf4b5ebf6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:26.278778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:26.279468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:26.279746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:26.280021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] PATH_INFO: `/v3/projects/8772630208de40308c4e365e2babd525/users/88bbe91c61c74cb09e653843524dcf0e/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:26.281930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8772630208de40308c4e365e2babd525, user_id=88bbe91c61c74cb09e653843524dcf0e, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:26.284614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:26.295940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1013/2029] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:26 2022] PUT /identity/v3/projects/8772630208de40308c4e365e2babd525/users/88bbe91c61c74cb09e653843524dcf0e/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:26.309434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:26.309728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:26.309994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:26.339521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] MFA Rules not processed for user `88bbe91c61c74cb09e653843524dcf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:26.340764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:26.432204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1017/2030] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:26.448939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:26.451130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:26.541171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf637f7-a254-4c84-9fc3-d7fdc13a838f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:26.545696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:26.546308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:26.546989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:26.546989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:26.620149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:26.621959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b4d45-f92c-478f-a47f-64677c35cc32 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:26.633010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1014/2031] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:30.151516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:30.167514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e79ee-f869-48d8-9878-fb9a0a0db57a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:30.172474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:30.173108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:30.173488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:30.173657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:30.186821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:30.188756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:30.200959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1018/2032] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:30.734772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:30.735360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:30.735450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:30.764745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] MFA Rules not processed for user `1eb44761a61846d79ea34e6d9b97ac9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:30.765938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:30.823688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:30.832553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1015/2033] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:30.837260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:30.838699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:30.908552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac773b-3b42-4c04-bc60-b0dc2c5ac668 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:30.913206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:30.913821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:30.914113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:30.914390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:30.915025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:30.917201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:30.933925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:31.051472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1019/2034] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:30 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:31.053034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:31.068750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26669-6cce-4e60-9503-b7d06d35808e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:31.137138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:31.137763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:31.138079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:31.138359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:31.138992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:31.141269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:31.249683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1016/2035] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:31 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:31.251313 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:31.262018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8036-25a5-4cda-a033-0063ad9bf7b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:31.266877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:31.267513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:31.267793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:31.268066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:31.268700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:31.270302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:31.281887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1020/2036] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:31.286289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:31.301201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4d98-f50e-43b0-930a-0e5ef2b2ba2a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:31.306758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:31.307604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:31.307888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:31.308164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] PATH_INFO: `/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf/users/e4fc43063cf3438b9fe3c7eaf95d480b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:31.324617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c746aaab084d0d9abf64d874a5f0bf, user_id=e4fc43063cf3438b9fe3c7eaf95d480b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:31.327216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:31.382947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1017/2037] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:31 2022] PUT /identity/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf/users/e4fc43063cf3438b9fe3c7eaf95d480b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:31.387134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:31.399795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31a36-c3c0-4ae1-aaf0-bbab02a2aa6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:31.474330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:31.475024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:31.475532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:31.476062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:31.477252 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:31.484003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:31.509804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:31.510296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1021/2038] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:46:31.526325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c862-aaa7-48bf-9801-62d01350a6d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:31.531254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:31.531928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:31.532214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:31.532656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] PATH_INFO: `/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf/users/e4fc43063cf3438b9fe3c7eaf95d480b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:31.548104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c746aaab084d0d9abf64d874a5f0bf, user_id=e4fc43063cf3438b9fe3c7eaf95d480b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:31.550876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d262f-a397-45f8-8ba5-da05e8fd64e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:31.585458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1018/2039] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:31 2022] PUT /identity/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf/users/e4fc43063cf3438b9fe3c7eaf95d480b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:38.741992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:38.744563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:38.761461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b70c1-a595-477e-8f43-fb687e3ae921 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:38.875403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:38.876058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:38.876493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:38.876610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] PATH_INFO: `/v3/users/43350a58ad2d4e9fb8cbd9125da4c7d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:38.878545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43350a58ad2d4e9fb8cbd9125da4c7d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:38.881536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:39.125392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43350a58ad2d4e9fb8cbd9125da4c7d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.126296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43350a58ad2d4e9fb8cbd9125da4c7d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.127270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43350a58ad2d4e9fb8cbd9125da4c7d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.136897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43350a58ad2d4e9fb8cbd9125da4c7d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.201744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:39.202412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:39.202412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:39.215899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43350a58ad2d4e9fb8cbd9125da4c7d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.235361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] MFA Rules not processed for user `e4fc43063cf3438b9fe3c7eaf95d480b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:39.236697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.245341 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:39.250229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1022/2040] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:38 2022] DELETE /identity/v3/users/43350a58ad2d4e9fb8cbd9125da4c7d1 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:39.331178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1019/2041] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:39.346818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:39.347291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.457524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e138e-096c-4b82-9223-91b92ec5d6a1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:39.461148 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:39.462731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:39.462731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:39.462888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:39.464748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.542439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:39.544615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7f7b-d960-4a38-9c0a-4a17a93a92df service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:39.549827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:39.551728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.573891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53dc24-1225-4e31-89db-e64a4c4405be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:39.576311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1023/2042] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:39.613363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:39.647152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:39.647821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:39.648097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:39.648430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] PATH_INFO: `/v3/projects/d058d98f4c8e4cfdb04a6a3558add380` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:39.650514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d058d98f4c8e4cfdb04a6a3558add380)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:39.652545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:39.772349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd058d98f4c8e4cfdb04a6a3558add380', 'request_id': 'req-b4f424cf-7850-48d2-b565-72e8533ce53b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.782121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd058d98f4c8e4cfdb04a6a3558add380', 'request_id': 'req-b4f424cf-7850-48d2-b565-72e8533ce53b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.829226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:39.829641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:39.829779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:39.850856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:39.852144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.885702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd058d98f4c8e4cfdb04a6a3558add380', 'request_id': 'req-b4f424cf-7850-48d2-b565-72e8533ce53b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.897805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] The token cache is being invalidate because project d058d98f4c8e4cfdb04a6a3558add380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:39.898102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.898751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:39.901141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1020/2043] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:39 2022] DELETE /identity/v3/projects/d058d98f4c8e4cfdb04a6a3558add380 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:39.905579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:39.906987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.911816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1024/2044] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:46:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:39.928948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:39.931213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:39.983190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:39.984112 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f424cf-7850-48d2-b565-72e8533ce53b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:39.990570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:39.991663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:39.991972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:39.992233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] PATH_INFO: `/v3/users/6ac5fca3087b47ebaef141ae36877e49` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:39.993629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac5fca3087b47ebaef141ae36877e49)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:39.995713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:40.013492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14ec3-4d04-46b6-8b19-aeb281126734 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:40.020126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:40.020742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:40.021026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:40.021340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:40.032592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:40.034747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:40.047654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1025/2045] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:46:40.289004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac5fca3087b47ebaef141ae36877e49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:40.290157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac5fca3087b47ebaef141ae36877e49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:40.291136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac5fca3087b47ebaef141ae36877e49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:40.301264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac5fca3087b47ebaef141ae36877e49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:40.315610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:40.331517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61b94d32-037d-41f5-bb57-5c7fb87c5673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac5fca3087b47ebaef141ae36877e49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:40.423519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1021/2046] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:39 2022] DELETE /identity/v3/users/6ac5fca3087b47ebaef141ae36877e49 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:41.076555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:41.083473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91427ad5-b47d-46d0-8d30-f328b52fe7cf service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:41.172328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:41.173111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:41.173407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:41.173685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] PATH_INFO: `/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:41.174955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2588a1c0b7034ef9a98fb4acfec6b4ba)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:41.177217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:41.322452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2588a1c0b7034ef9a98fb4acfec6b4ba', 'request_id': 'req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:41.333072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2588a1c0b7034ef9a98fb4acfec6b4ba', 'request_id': 'req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:41.344706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2588a1c0b7034ef9a98fb4acfec6b4ba', 'request_id': 'req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:41.418438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] The token cache is being invalidate because project 2588a1c0b7034ef9a98fb4acfec6b4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:41.419064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:41.420016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2463580d-3fa5-4b91-a3f1-a6c0ee3c1b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:41.422542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1026/2047] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:41 2022] DELETE /identity/v3/projects/2588a1c0b7034ef9a98fb4acfec6b4ba => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:41.428517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:41.429078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:41.429078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:41.494077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:41.495907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:41.643744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1022/2048] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:41.645365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:41.645841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:41.646425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:41.683371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:41.684816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:41.702909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1027/2049] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:41.704457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:41.718445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66fe7d-d4ab-4a71-aa58-50615e11f4c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:41.728931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:41.731402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:41.731861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:41.735635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:41.739148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:46:41.739148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:41.742107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:41.773819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1023/2050] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:46:41.776404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:41.790663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5bbc7-9c15-463d-904e-7088da4d01ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:41.807064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:41.808568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:41.808861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:41.809174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:41.809776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:41.811919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:41.932079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1028/2051] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:41 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:46:41.933109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:41.944241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac65e-e178-42dd-9a38-c28e3e109192 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:42.041040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:42.042086 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.042473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.043135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.043872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:42.047211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:42.120144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1024/2052] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:41 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:42.123888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:42.135306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b327-8dd5-460d-a677-8a82d4a35c2f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:42.152065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:42.152837 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.153123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.153398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.154157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:42.155816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:42.181705 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1029/2053] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:42.185783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:42.199028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967031b-069f-40a8-a5d1-a33b0f7473ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:42.204187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:42.206474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.206474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.206474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.206474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:42.207800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be72d5-54b4-44fe-a625-fd39d1797d62 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:42.221382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1025/2054] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:42.226727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:42.244414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20853a8-858e-4021-ba85-2409c5045f16 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:42.278694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:42.278694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.278694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.278694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] PATH_INFO: `/v3/projects/029f90d6005a4e7f80e29b298a1dbbaf/users/d659c4a742094f99b1636070d4a98975/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.311061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029f90d6005a4e7f80e29b298a1dbbaf, user_id=d659c4a742094f99b1636070d4a98975, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:42.314979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:42.317671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:42.402769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1030/2055] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:42 2022] PUT /identity/v3/projects/029f90d6005a4e7f80e29b298a1dbbaf/users/d659c4a742094f99b1636070d4a98975/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:42.422410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.422410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.422410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.457064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] MFA Rules not processed for user `d659c4a742094f99b1636070d4a98975`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:42.459048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:42.527040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:42.568985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1026/2056] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:42.574800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:42.684227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a13a7-9e2d-4112-a880-bc3efbcc09e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:42.697902 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:42.698845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:42.699326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:42.699755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:42.700548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:42.702692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:42.900124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1031/2057] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:42 2022] POST /identity/v3/projects => generated 383 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:42.903298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:42.951876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0063e83-20e9-49bb-aa18-f611f8c36ae5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:43.053360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:43.054097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.054380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.054657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.055327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:43.059129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:43.171166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1027/2058] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:42 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:43.216010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:43.229810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66bcd-0612-440f-a0e7-b1fc28060c95 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:43.235028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:43.235784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.236140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.236490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.238054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:43.238962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:43.254636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1032/2059] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:43.256372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:43.273008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068a1f-4db1-4677-9845-c39d9fc243bb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:43.300936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:43.300936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.300936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.300936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] PATH_INFO: `/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa/users/5aaf0114138e486989878826c31ff716/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.306804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c1c05b76b94cb8a4f3a7065176edfa, user_id=5aaf0114138e486989878826c31ff716, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:43.309524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:43.629942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1028/2060] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:43 2022] PUT /identity/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa/users/5aaf0114138e486989878826c31ff716/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:43.634272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:43.646160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dd387-4b9e-48b7-b0b8-adaaff5cf98f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:43.711411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:43.712668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.713002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.713273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.713878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:43.715684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79351d68-fbd6-4a6b-ae57-018b0bd09c8c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:43.728153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1033/2061] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:43.732415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:43.745893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf0f2-ddd4-4f37-be5c-b9279a7abca4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:43.749589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:43.755065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.755065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.755065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] PATH_INFO: `/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa/users/5aaf0114138e486989878826c31ff716/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.755065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c1c05b76b94cb8a4f3a7065176edfa, user_id=5aaf0114138e486989878826c31ff716, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:43.756096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:43.772096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1029/2062] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:43 2022] PUT /identity/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa/users/5aaf0114138e486989878826c31ff716/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:43.783156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:43.785106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:43.785106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:43.814646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] MFA Rules not processed for user `5aaf0114138e486989878826c31ff716`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:43.815913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:43.913231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:43.960715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1034/2063] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:43.973178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:43.975812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:44.079007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7a0b-8b5b-4da9-b8fa-c4c03ed2dbf4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:44.083434 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:44.084372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:44.084624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:44.084901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:44.155102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:44.172916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:44.175140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7973a-6f24-4118-be01-e87f4b57230b service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:44.209105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1030/2064] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:48.213350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:48.214780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:48.300877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc7ca1-da85-4f10-ad7d-b0aa1095ec96 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:48.306694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:48.307107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:48.307404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:48.307946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] PATH_INFO: `/v3/users/0f1a1d0e13ba472ba54bd6a7671b5c09` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:48.309157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1a1d0e13ba472ba54bd6a7671b5c09)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:48.311310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:48.539500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1a1d0e13ba472ba54bd6a7671b5c09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:48.541126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1a1d0e13ba472ba54bd6a7671b5c09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:48.541901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1a1d0e13ba472ba54bd6a7671b5c09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:48.550351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1a1d0e13ba472ba54bd6a7671b5c09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:48.627473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1a1d0e13ba472ba54bd6a7671b5c09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:48.657189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:48.657781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:48.657781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:48.663857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1035/2065] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:48 2022] DELETE /identity/v3/users/0f1a1d0e13ba472ba54bd6a7671b5c09 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:48.689648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:48.690908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:48.777169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1031/2066] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:48.789559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:48.791723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:48.876512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c40b-445e-4ead-b340-1f7633b5ecf6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:48.882306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:48.882306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:48.882306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:48.882306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:48.892752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:48.894318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:48.910105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1036/2067] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:49.462965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:49.462965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:49.469359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b838-431d-4a68-bf94-30573dba4d3d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:49.476903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:49.478133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:49.478427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:49.478705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] PATH_INFO: `/v3/projects/5b7781ecaf6c4b51838a2c76d3ecce41` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:49.480048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7781ecaf6c4b51838a2c76d3ecce41)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:49.481844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:49.599650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7781ecaf6c4b51838a2c76d3ecce41', 'request_id': 'req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:49.610117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7781ecaf6c4b51838a2c76d3ecce41', 'request_id': 'req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:49.678537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7781ecaf6c4b51838a2c76d3ecce41', 'request_id': 'req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:49.693376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] The token cache is being invalidate because project 5b7781ecaf6c4b51838a2c76d3ecce41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:49.693670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:49.696979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:49.699478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1032/2068] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:49 2022] DELETE /identity/v3/projects/5b7781ecaf6c4b51838a2c76d3ecce41 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:49.703443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:49.716316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8603-f0e2-4000-913a-e60d6e08e824 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:49.725864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:49.787027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:49.787861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:49.788141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:49.788414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] PATH_INFO: `/v3/users/88bbe91c61c74cb09e653843524dcf0e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:49.789652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bbe91c61c74cb09e653843524dcf0e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:49.792226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:50.511839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bbe91c61c74cb09e653843524dcf0e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:50.512489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bbe91c61c74cb09e653843524dcf0e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:50.513117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bbe91c61c74cb09e653843524dcf0e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:50.520981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bbe91c61c74cb09e653843524dcf0e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:50.611053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bbe91c61c74cb09e653843524dcf0e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:50.645894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1037/2069] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:49 2022] DELETE /identity/v3/users/88bbe91c61c74cb09e653843524dcf0e => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:51.275524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:51.277085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.296893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5431969-58e3-4c1f-95e0-c7a94e18b9a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:51.369474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:51.370108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.370387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.370659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] PATH_INFO: `/v3/projects/8772630208de40308c4e365e2babd525` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.371819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8772630208de40308c4e365e2babd525)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:51.373850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:51.386147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:51.419267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:51.421222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.481758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cd94-917a-4242-a05b-b985974971b6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:51.485348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:51.485978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.486257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.486539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.488322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.532529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8772630208de40308c4e365e2babd525', 'request_id': 'req-a084d9c0-2b74-4c30-8255-6ebcab5f9056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:51.544806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8772630208de40308c4e365e2babd525', 'request_id': 'req-a084d9c0-2b74-4c30-8255-6ebcab5f9056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:51.552023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:51.575870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:51.579256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f8b8e-2c72-4ded-b8b4-3f28b2eccf8c service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:51.593517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1038/2070] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:51.627476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8772630208de40308c4e365e2babd525', 'request_id': 'req-a084d9c0-2b74-4c30-8255-6ebcab5f9056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:51.641294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] The token cache is being invalidate because project 8772630208de40308c4e365e2babd525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:51.641666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:51.642336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a084d9c0-2b74-4c30-8255-6ebcab5f9056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:51.644418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1033/2071] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:51 2022] DELETE /identity/v3/projects/8772630208de40308c4e365e2babd525 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:51.649953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447892a1-8709-477b-b9db-6073da2113f2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.651889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447892a1-8709-477b-b9db-6073da2113f2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.651889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447892a1-8709-477b-b9db-6073da2113f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.677792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-447892a1-8709-477b-b9db-6073da2113f2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:51.679199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-447892a1-8709-477b-b9db-6073da2113f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.713670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.714004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.714337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.737189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] MFA Rules not processed for user `1eb44761a61846d79ea34e6d9b97ac9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:51.738418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.780211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1039/2072] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:51.788741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.789029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.789304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.812955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:51.814676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:51.814819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1034/2073] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:51.823910 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1040/2074] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:51.828306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:51.842483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc964df-e10d-4546-8bc5-e41e4dbdf655 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:51.852451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:51.853128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.853370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.853630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.854282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:46:51.854586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:51.856320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:51.875059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1035/2075] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:46:51.875441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:51.885752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52c4c-7ad4-440f-b0d1-2f0607045f40 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:51.890863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:51.892306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:51.892306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:51.892306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:51.892825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:51.894734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.043419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1041/2076] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:51 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:52.046726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.061963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037be554-9a62-4c43-b17f-1edef6fdb488 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.136644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.137351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.137698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.138047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.139115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.141518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.226797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1036/2077] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:52 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:52.232879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.246076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdce03-46da-4dd5-9405-dfa142a5c222 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.254139 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.255834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.257204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.257721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.259253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.261772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.284298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1042/2078] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:52.285609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.306245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2010b-201a-4a5a-b633-ef1303e57eae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.307903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.308531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.308817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.309093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.309751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.311547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6f72-3dda-488f-9def-c61cc6a2140b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.323920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1037/2079] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:52.328188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.349324 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddfa6-d5b9-40a8-881e-3c417d98f042 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.360279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.360959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.361239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.361665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] PATH_INFO: `/v3/projects/d0806ff0fb4e4ad3a207446cf43e2300/users/716a924c7c674db2a08c655864bc5028/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.387000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0806ff0fb4e4ad3a207446cf43e2300, user_id=716a924c7c674db2a08c655864bc5028, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.390556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.457463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1043/2080] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:52 2022] PUT /identity/v3/projects/d0806ff0fb4e4ad3a207446cf43e2300/users/716a924c7c674db2a08c655864bc5028/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:52.469778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.470074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.470350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.490633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:52.501049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] MFA Rules not processed for user `716a924c7c674db2a08c655864bc5028`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:52.502884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:52.607536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1038/2081] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:52.612084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.693301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32646e-4b92-424a-9cb3-d1aa452079f5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.704932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.705560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.705846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.706126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.707062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.709018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:52.832840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1044/2082] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:46:52 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:52.833911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:52.845442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9cec-f26e-4fbc-93bb-70b2aa7a01e7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:52.911558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:52.912635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:52.913153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:52.915574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:52.915574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:52.918809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.028564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1039/2083] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:46:52 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:46:53.036033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.041716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:53.050604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09193ab-61b1-4e10-a1b0-20e456c7fe35 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.054152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.054982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.055863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.056315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.056978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.058583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.075204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1045/2084] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:53.079722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.090596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1462-1733-4f39-ae29-9adb35a86246 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.095630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.096303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.096584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.096856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] PATH_INFO: `/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7/users/1da9e476515c4e6fa226efba1737a66b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.113129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca10c31f6a34cd4a3438fe7a09d97d7, user_id=1da9e476515c4e6fa226efba1737a66b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.115907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.189650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1040/2085] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:53 2022] PUT /identity/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7/users/1da9e476515c4e6fa226efba1737a66b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:53.193996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.205532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c00dc7-4bbb-4ebf-abdb-9c4a43ffcc77 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.262892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.263609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.263897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.264234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.264842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.266582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341da83-74d9-4852-9bcf-868470d88486 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.277111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1046/2086] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:46:53.281367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.293152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42cc5-435f-4a24-ad4a-dcf737817058 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.298218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.298856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.299160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.299435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] PATH_INFO: `/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7/users/1da9e476515c4e6fa226efba1737a66b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.301466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca10c31f6a34cd4a3438fe7a09d97d7, user_id=1da9e476515c4e6fa226efba1737a66b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.304136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.315532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1041/2087] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:46:53 2022] PUT /identity/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7/users/1da9e476515c4e6fa226efba1737a66b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:46:53.326236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.326529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.326809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.357786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] MFA Rules not processed for user `1da9e476515c4e6fa226efba1737a66b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:53.359275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:53.441018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1047/2088] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:53.453420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.455871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:53.526117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9c9d-58e9-4a6e-b578-cb09348955df admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.530048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.530669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.530947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.531416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.539464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:53.544825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.546331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.557781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1042/2089] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:53.667325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:53.682000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e5e5-53d2-4444-8098-b962cb954ba5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:53.682000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:53.682663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:53.682950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:53.683262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:53.760956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:53.762406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b22cf-e6bd-4bc1-8299-77810443de28 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:53.771382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1048/2090] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:57.088284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:57.173079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e067265-7774-4a81-a56e-62295fa1134d service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:57.178537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:57.179407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.179805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.180306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] PATH_INFO: `/v3/users/716a924c7c674db2a08c655864bc5028` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.181817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716a924c7c674db2a08c655864bc5028)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:57.184141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:57.378336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716a924c7c674db2a08c655864bc5028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:57.378336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716a924c7c674db2a08c655864bc5028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:57.378895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716a924c7c674db2a08c655864bc5028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:57.385171 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.385687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.385795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.391783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716a924c7c674db2a08c655864bc5028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:57.409488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:57.409724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ac8e6a-a447-449f-a029-f3faa78b8719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716a924c7c674db2a08c655864bc5028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:57.410740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:57.416918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:57.473997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1049/2091] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:57.488316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1043/2092] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:57 2022] DELETE /identity/v3/users/716a924c7c674db2a08c655864bc5028 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:57.488428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:57.489541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.489833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.490115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.491844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:57.514014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:57.516397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:57.582496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a5fdf-5623-4180-bffd-621d952f237a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:57.587038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1044/2093] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:46:57.596998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:57.598384 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:57.612784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:57.664275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:57.665771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.666174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.666435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.690943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363264-302a-4cce-892c-5ae2117bcdfe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:57.695442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:57.696889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.697448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.697848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.710239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:57.713593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:57.731070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1045/2094] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:46:57.731891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:57.733332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:57.749041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f9ba9-8198-4ecb-802d-7a85d81e94d3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:57.758831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:57.760337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:57.760644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:57.761089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] PATH_INFO: `/v3/users/d659c4a742094f99b1636070d4a98975` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:57.763833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d659c4a742094f99b1636070d4a98975)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:57.767513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:57.768425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:57.772272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedd9d1-be46-427c-9485-4107db954906 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:57.782749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:57.796282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1050/2095] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:58.088118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd659c4a742094f99b1636070d4a98975'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.090092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd659c4a742094f99b1636070d4a98975'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.090957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd659c4a742094f99b1636070d4a98975'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.111777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd659c4a742094f99b1636070d4a98975'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.182634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd659c4a742094f99b1636070d4a98975'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.256450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1046/2096] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:57 2022] DELETE /identity/v3/users/d659c4a742094f99b1636070d4a98975 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:58.262241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:58.262956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:58.263517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:58.293166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:46:58.294857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:58.382425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1051/2097] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:46:58.393192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:58.394947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:58.429539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:58.431909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:58.463199 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45afbf0-94ab-47d2-b867-21db9ad64273 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:58.472195 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:58.472907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:58.473312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:58.473462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] PATH_INFO: `/v3/projects/d0806ff0fb4e4ad3a207446cf43e2300` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:58.474946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0806ff0fb4e4ad3a207446cf43e2300)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:58.477352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:58.533903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575520-5f7c-472d-8c19-45508a31bcb2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:58.538075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:58.540026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:58.540026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:58.541220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:58.552076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:58.554033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:58.565941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1047/2098] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:46:58.643822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0806ff0fb4e4ad3a207446cf43e2300', 'request_id': 'req-e70d1908-0733-4791-8488-e9f427beba11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.657109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0806ff0fb4e4ad3a207446cf43e2300', 'request_id': 'req-e70d1908-0733-4791-8488-e9f427beba11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.668137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0806ff0fb4e4ad3a207446cf43e2300', 'request_id': 'req-e70d1908-0733-4791-8488-e9f427beba11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.804767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] The token cache is being invalidate because project d0806ff0fb4e4ad3a207446cf43e2300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:58.808726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.808726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:58.808726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1052/2099] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:58 2022] DELETE /identity/v3/projects/d0806ff0fb4e4ad3a207446cf43e2300 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:58.812056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:58.826338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39d46-22a7-49f8-a5ec-a71f313d736a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:58.885076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:58.939586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:58.940329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:58.940828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:58.941182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] PATH_INFO: `/v3/users/1da9e476515c4e6fa226efba1737a66b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:58.942762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da9e476515c4e6fa226efba1737a66b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:58.945454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:59.150463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:59.152701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:59.173421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d1908-0733-4791-8488-e9f427beba11 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:59.205051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:59.205051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:59.205051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:59.205051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] PATH_INFO: `/v3/projects/029f90d6005a4e7f80e29b298a1dbbaf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:59.205351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029f90d6005a4e7f80e29b298a1dbbaf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:59.205351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:59.205482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da9e476515c4e6fa226efba1737a66b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.205482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da9e476515c4e6fa226efba1737a66b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.205482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da9e476515c4e6fa226efba1737a66b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.215694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da9e476515c4e6fa226efba1737a66b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.232552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da9e476515c4e6fa226efba1737a66b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.307042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1048/2100] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:58 2022] DELETE /identity/v3/users/1da9e476515c4e6fa226efba1737a66b => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:59.338675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029f90d6005a4e7f80e29b298a1dbbaf', 'request_id': 'req-e59f50a4-8731-4ddd-9f03-633df4f1a271'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.346940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029f90d6005a4e7f80e29b298a1dbbaf', 'request_id': 'req-e59f50a4-8731-4ddd-9f03-633df4f1a271'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.367643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029f90d6005a4e7f80e29b298a1dbbaf', 'request_id': 'req-e59f50a4-8731-4ddd-9f03-633df4f1a271'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.434227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] The token cache is being invalidate because project 029f90d6005a4e7f80e29b298a1dbbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:46:59.434821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.435308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.436842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1053/2101] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:59 2022] DELETE /identity/v3/projects/029f90d6005a4e7f80e29b298a1dbbaf => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:46:59.440907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:59.442562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:59.523666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930f4b-3dee-4184-a744-8bb9d0b9e4a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:59.595905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:59.603195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:59.603992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:59.604404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:59.604818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] PATH_INFO: `/v3/users/5aaf0114138e486989878826c31ff716` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:59.606047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aaf0114138e486989878826c31ff716)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:59.608475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:59.824007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aaf0114138e486989878826c31ff716'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.824706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aaf0114138e486989878826c31ff716'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.825326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aaf0114138e486989878826c31ff716'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.834855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aaf0114138e486989878826c31ff716'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.838754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:46:59.840706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:46:59.867483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-639a8740-f0e0-4902-ab27-26f7ba057bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aaf0114138e486989878826c31ff716'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:46:59.884426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50a4-8731-4ddd-9f03-633df4f1a271 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:46:59.889644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:46:59.893263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:46:59.893263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:46:59.893263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] PATH_INFO: `/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:46:59.893263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca10c31f6a34cd4a3438fe7a09d97d7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:46:59.894711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:46:59.897943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:59.949190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1049/2102] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:46:59 2022] DELETE /identity/v3/users/5aaf0114138e486989878826c31ff716 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:00.025432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca10c31f6a34cd4a3438fe7a09d97d7', 'request_id': 'req-ee72f19d-e87c-415b-b477-439d2c89e061'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.031931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca10c31f6a34cd4a3438fe7a09d97d7', 'request_id': 'req-ee72f19d-e87c-415b-b477-439d2c89e061'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.040927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca10c31f6a34cd4a3438fe7a09d97d7', 'request_id': 'req-ee72f19d-e87c-415b-b477-439d2c89e061'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.120461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] The token cache is being invalidate because project dca10c31f6a34cd4a3438fe7a09d97d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:00.121440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.121440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ee72f19d-e87c-415b-b477-439d2c89e061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.122974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1054/2103] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:46:59 2022] DELETE /identity/v3/projects/dca10c31f6a34cd4a3438fe7a09d97d7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:00.129382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0987-9350-424a-938a-ceef77ae723c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.129739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0987-9350-424a-938a-ceef77ae723c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.130060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0987-9350-424a-938a-ceef77ae723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.158620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-beea0987-9350-424a-938a-ceef77ae723c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:00.160575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-beea0987-9350-424a-938a-ceef77ae723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.244464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1050/2104] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:00.253891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.254556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.254886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.277806 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:00.279041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.291844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1055/2105] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:00.293579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0987-9350-424a-938a-ceef77ae723c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.309665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0987-9350-424a-938a-ceef77ae723c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.324614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.325341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.325688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.326036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.335442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:00.335909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.338379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.355134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1051/2106] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:00.359652 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.376896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d758b-f673-4086-88da-ca3344fd0846 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.382470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.383141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.383583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.383862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.384492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.386441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.491447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.497370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1056/2107] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:00.499681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.502719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.503962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348119-6d3a-4837-8226-b24a379754eb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.586987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.586987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.586987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.586987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.587835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.588392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.599303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:00.600629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e1df-71e5-48dd-909d-1b390c047701 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.608674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.609339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.609616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.609888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] PATH_INFO: `/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.611021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c1c05b76b94cb8a4f3a7065176edfa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.612956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.730738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1052/2108] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:47:00.735963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.747416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc650e-1c04-4275-b457-d534c3f0468b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.757443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c1c05b76b94cb8a4f3a7065176edfa', 'request_id': 'req-591b56c6-7d22-43e2-ae91-f62a95347cc2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.763801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c1c05b76b94cb8a4f3a7065176edfa', 'request_id': 'req-591b56c6-7d22-43e2-ae91-f62a95347cc2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.770027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c1c05b76b94cb8a4f3a7065176edfa', 'request_id': 'req-591b56c6-7d22-43e2-ae91-f62a95347cc2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.803639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:00.809564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.810257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.810535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.810809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.811575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.813408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.827964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1053/2109] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:47:00.829647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.842567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98881-438b-4926-862d-e309bfb05633 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.849312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] The token cache is being invalidate because project c0c1c05b76b94cb8a4f3a7065176edfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:00.849312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.849312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591b56c6-7d22-43e2-ae91-f62a95347cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:00.849595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.849595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.850031 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1057/2110] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:00 2022] DELETE /identity/v3/projects/c0c1c05b76b94cb8a4f3a7065176edfa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:00.850143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.850371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.851302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.853881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.856864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f99e-b2bf-4d2a-8091-53997e81727d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.857157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f99e-b2bf-4d2a-8091-53997e81727d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.857437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f99e-b2bf-4d2a-8091-53997e81727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.865330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1054/2111] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:00.881981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a637f99e-b2bf-4d2a-8091-53997e81727d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:00.883848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a637f99e-b2bf-4d2a-8091-53997e81727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.886389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.892064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.903183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1058/2112] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:00.909932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.910666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.911149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.921917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e57e-6dae-4707-ba7d-a3da7bed17f3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.935211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:00.941357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:00.941357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:00.941357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] PATH_INFO: `/v3/projects/93cfc546f8fc4041b4857d4d07f52740/users/fa75b2b5b43f43649d74c2c19ecd6aaf/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:00.956153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:00.957582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:00.963379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cfc546f8fc4041b4857d4d07f52740, user_id=fa75b2b5b43f43649d74c2c19ecd6aaf, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:00.966105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c82306-5dea-4129-9efa-86ed6ff8f4a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:00.969015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1059/2113] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:00.980456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:00.994616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fdae6-6329-4333-b7f9-1ae7bc8bddd5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:00.999612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.000230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.000512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.000782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.001568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:01.001920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.003774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.018777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1060/2114] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:01.023251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.034618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983155c5-9a9e-45bc-b871-b53d26a3fde7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.050322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.051100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.051100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.051388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.052027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.054359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.056060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1055/2115] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:00 2022] PUT /identity/v3/projects/93cfc546f8fc4041b4857d4d07f52740/users/fa75b2b5b43f43649d74c2c19ecd6aaf/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:01.068245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.069154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.069659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.113202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] MFA Rules not processed for user `fa75b2b5b43f43649d74c2c19ecd6aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:01.114517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:01.151376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1061/2116] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:01 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:01.155311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.191203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1056/2117] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:01.204018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.205442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:01.223932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab890a4-8d41-42f2-b51d-a829ee5c4167 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.230397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.231155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.231557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.232047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.232842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.235262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.297012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269961-4e30-42f6-863a-e26ebcf40a64 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.330643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1062/2118] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:01 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:01.334743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.358415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c958fc-924b-4951-a6f4-1b8a13e071d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.369339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.369908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.370196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.370481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.371327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.373434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.384793 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1063/2119] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:47:01.387807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.387807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.387807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.387807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.389212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.400462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d2dc8-11e0-4990-8d78-67e3ee622116 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.405895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.406894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.406990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.407802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.407926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.409496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.438338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1064/2120] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:01.444770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:01.445192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.459906 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb700a-7eca-41ce-a860-2fda83c8a779 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.466416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.467247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.467549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.468461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] PATH_INFO: `/v3/projects/40eb4dbb350a44ff874104eba585aa8d/users/354180699c574605ae66cfa798408cdb/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.501373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.502361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.504462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eb4dbb350a44ff874104eba585aa8d, user_id=354180699c574605ae66cfa798408cdb, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.511010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d2cba-6dd6-46cb-9ca5-d217f9ba428f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.520778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1057/2121] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:01.546113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.558945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e66-8ed6-43bc-bb0a-3c6f2a39c01e service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.565711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.566486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.566655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.566907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] PATH_INFO: `/v3/users/fa75b2b5b43f43649d74c2c19ecd6aaf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.568180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa75b2b5b43f43649d74c2c19ecd6aaf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.571425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.579210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1065/2122] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:01 2022] PUT /identity/v3/projects/40eb4dbb350a44ff874104eba585aa8d/users/354180699c574605ae66cfa798408cdb/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:47:01.597326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.599412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.599860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.633073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] MFA Rules not processed for user `354180699c574605ae66cfa798408cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:01.635997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:01.679050 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:01.723612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1066/2123] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:01.740465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:01.741914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:01.808375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa75b2b5b43f43649d74c2c19ecd6aaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:01.809319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa75b2b5b43f43649d74c2c19ecd6aaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:01.810148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa75b2b5b43f43649d74c2c19ecd6aaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:01.821491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa75b2b5b43f43649d74c2c19ecd6aaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:01.828964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a20eb-5e45-4194-910a-e3584dbd0bfd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:01.834309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:01.835072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.836028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.837109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:01.840778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:01.858158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa75b2b5b43f43649d74c2c19ecd6aaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:01.863254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:01.865859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64531e81-2a1b-40b8-a0d5-93c04009692b service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:01.882948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1067/2124] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:01.942702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1058/2125] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:47:01 2022] DELETE /identity/v3/users/fa75b2b5b43f43649d74c2c19ecd6aaf => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:47:01.944532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbef242-9ce3-4650-8f2d-39a71096bb4e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:01.948239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbef242-9ce3-4650-8f2d-39a71096bb4e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:01.948239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbef242-9ce3-4650-8f2d-39a71096bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:02.002465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2fbef242-9ce3-4650-8f2d-39a71096bb4e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:02.004862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2fbef242-9ce3-4650-8f2d-39a71096bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:02.175134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1068/2126] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:02.187672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:02.189159 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:02.276810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:02.366334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3901-45aa-42a6-a65c-a1c7b55a4a19 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:02.380894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:02.381523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:02.383770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:02.384822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:02.409207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:02.409421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:02.429052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1059/2127] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:02.733803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33475-e3e9-410b-9172-37cc24cfdbfb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:02.734381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33475-e3e9-410b-9172-37cc24cfdbfb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:02.734381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33475-e3e9-410b-9172-37cc24cfdbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:02.764826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-73c33475-e3e9-410b-9172-37cc24cfdbfb None None] MFA Rules not processed for user `5f4abead0b4e4ad9ab6e0bb267e5115e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:02.766073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73c33475-e3e9-410b-9172-37cc24cfdbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:02.839690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1069/2128] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:02.961946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:02.965799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:03.006737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff970c-03b6-4c5f-a5a6-5b2f0f134aaa service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:03.022866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:03.025142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:03.025142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:03.025142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] PATH_INFO: `/v3/projects/93cfc546f8fc4041b4857d4d07f52740` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:03.040368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cfc546f8fc4041b4857d4d07f52740)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:03.043653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:03.225539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cfc546f8fc4041b4857d4d07f52740', 'request_id': 'req-64ea699e-b831-44cd-be92-d9f57af4300e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:03.233069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cfc546f8fc4041b4857d4d07f52740', 'request_id': 'req-64ea699e-b831-44cd-be92-d9f57af4300e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:03.312948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cfc546f8fc4041b4857d4d07f52740', 'request_id': 'req-64ea699e-b831-44cd-be92-d9f57af4300e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:03.327449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] The token cache is being invalidate because project 93cfc546f8fc4041b4857d4d07f52740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:03.327748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:03.328414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64ea699e-b831-44cd-be92-d9f57af4300e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:03.330094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1060/2129] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:02 2022] DELETE /identity/v3/projects/93cfc546f8fc4041b4857d4d07f52740 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:03.337483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:03.337863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:03.338210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:03.382146 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:03.395196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:03.460254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:03.574728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1070/2130] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:03.578310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:03.578816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:03.579243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:03.616652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:03.620071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:03.649017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1061/2131] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:03.652789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:03.670276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3735-bbce-4b47-b491-9e2f3248e01e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:03.683526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:03.685458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:03.685730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:03.686000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:03.686656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:03.686957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:03.691022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:03.715497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1071/2132] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:03.719585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:03.730532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82158d4-55b9-419c-bd48-395e608406f5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:03.740454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:03.747808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:03.747808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:03.747808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:03.747808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:03.747808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:03.888217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1062/2133] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:03 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:03.891394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:03.910162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e0bdf-b3a8-4792-90fe-18c8304ae00f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:04.050231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:04.050900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:04.051177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:04.051501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:04.052079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:04.054067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:04.676769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1072/2134] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:03 2022] POST /identity/v3/users => generated 292 bytes in 787 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:04.682045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:04.695273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcb6-66c9-49de-b9b0-ae67eeea90cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:04.700475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:04.774641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1063/2135] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:47:04.781880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:04.799722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6821-af65-4703-8452-79147f5b404d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:04.818809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:04.819767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:04.821209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:04.822815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:04.827467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:04.830208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead6772-efc5-41a0-acbe-4775c5751633 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:04.860346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1073/2136] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:04.864370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:04.878939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c5508-8a29-4def-b627-aadfa62b0b69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:04.888005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:04.888890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:04.892129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:04.893393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] PATH_INFO: `/v3/projects/dbd7b01fe1d642d2bc66350c04f1c16b/users/95c0649c80d34a8fbcc91e9bae6bbab0/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:04.919933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd7b01fe1d642d2bc66350c04f1c16b, user_id=95c0649c80d34a8fbcc91e9bae6bbab0, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:04.925950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:05.725120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1064/2137] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:04 2022] PUT /identity/v3/projects/dbd7b01fe1d642d2bc66350c04f1c16b/users/95c0649c80d34a8fbcc91e9bae6bbab0/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:05.737573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:05.741963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:05.741963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:05.794969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] MFA Rules not processed for user `95c0649c80d34a8fbcc91e9bae6bbab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:05.796563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:05.891881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1074/2138] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:05.934985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:05.937141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:06.038623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:06.043906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141529-3ea5-4dca-a5b4-27c66b9a3bfe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:06.050334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:06.051418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:06.051865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:06.052250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:06.063060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:06.065264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237882dd-b92f-42f2-b93f-8a9867daa16e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:06.078439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1065/2139] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:15.628765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:15.656994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:15.700242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6dd62-f0e7-4e4d-aeca-c9acd6bba539 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:15.705791 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:15.706532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:15.706817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:15.707113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] PATH_INFO: `/v3/users/95c0649c80d34a8fbcc91e9bae6bbab0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:15.708308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c0649c80d34a8fbcc91e9bae6bbab0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:15.710265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:15.904069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c0649c80d34a8fbcc91e9bae6bbab0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:15.904667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c0649c80d34a8fbcc91e9bae6bbab0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:15.905337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c0649c80d34a8fbcc91e9bae6bbab0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:15.912495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c0649c80d34a8fbcc91e9bae6bbab0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:15.993344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c0649c80d34a8fbcc91e9bae6bbab0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.030866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1075/2140] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:47:15 2022] DELETE /identity/v3/users/95c0649c80d34a8fbcc91e9bae6bbab0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:16.035409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:16.035962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:16.035962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:16.057288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:16.058453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:16.120200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1066/2141] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:16.130771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:16.132948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:16.193277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5005-6a42-4dab-b109-dc9a8be48873 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:16.197024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:16.197855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:16.198138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:16.198417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:16.207706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:16.209227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb468-7bd5-4c3a-83b0-80b4982ed157 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:16.219982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1076/2142] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:16.717941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:16.717941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:16.736701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fea2c-4f63-4e9f-8290-b36c94c94b07 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:16.742039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:16.742822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:16.743170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:16.743458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] PATH_INFO: `/v3/projects/dbd7b01fe1d642d2bc66350c04f1c16b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:16.744958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd7b01fe1d642d2bc66350c04f1c16b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:16.746898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:16.893873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd7b01fe1d642d2bc66350c04f1c16b', 'request_id': 'req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.906750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd7b01fe1d642d2bc66350c04f1c16b', 'request_id': 'req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.982632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd7b01fe1d642d2bc66350c04f1c16b', 'request_id': 'req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.995843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] The token cache is being invalidate because project dbd7b01fe1d642d2bc66350c04f1c16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:16.996135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.997133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1590aa77-b3c1-4d5d-92ed-78a2e0d9cab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:16.998877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1067/2143] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:16 2022] DELETE /identity/v3/projects/dbd7b01fe1d642d2bc66350c04f1c16b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:17.003655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.004175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.004269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.027436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:17.028649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:17.078292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:17.100764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1077/2144] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:17.109470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.110464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.110464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.131028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:17.132283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:17.142126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1068/2145] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:17.146471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.157261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67e3c-403c-45ef-97d9-8f0948c453cf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.162755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.163409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.164127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.164410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.165060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:17.165360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.168292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.182952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1078/2146] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:17.187222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.197948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165475-f482-4acd-a8cc-4b93af3a4f19 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.203603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.204440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.204787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.205122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.205838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.208174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.301422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1069/2147] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:17 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:17.306520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.324384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000e58-67f9-4ad3-a662-7fb9a10a73d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.397945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.398925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.399395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.399904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.401302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.403437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.490290 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1079/2148] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:17 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:17.494663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.505673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b27522-a9db-484e-86c4-473bed1016e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.510954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.511643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.514727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.514727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.514727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.515005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.525092 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1070/2149] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:17.530596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.540611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636fa85-56de-4a2a-bb47-4bd76a3ea5f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.545706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.546306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.546578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.546846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.547542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.549144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0cdcd-86ec-42e8-b4d6-a278e878d292 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.560674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1080/2150] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:17.564858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.576363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a77b0e-a63d-40a3-a7b3-0f25418374aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.581120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.581783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.582065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.582338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] PATH_INFO: `/v3/projects/87c8d59385d842209fe2f28ea800ee57/users/fc6c463460504af5a2efade9d049216d/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.597860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c8d59385d842209fe2f28ea800ee57, user_id=fc6c463460504af5a2efade9d049216d, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.600595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.676272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1071/2151] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:17 2022] PUT /identity/v3/projects/87c8d59385d842209fe2f28ea800ee57/users/fc6c463460504af5a2efade9d049216d/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:17.682422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92320-1f73-4069-b63a-33f30e9a6196 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.682877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92320-1f73-4069-b63a-33f30e9a6196 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.683249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e92320-1f73-4069-b63a-33f30e9a6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.705254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-46e92320-1f73-4069-b63a-33f30e9a6196 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:17.706714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46e92320-1f73-4069-b63a-33f30e9a6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:17.777933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1081/2152] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:17.788262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:17.790550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:17.806124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:17.854443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339374a-df1a-47fd-9fe0-6fe020877d47 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:17.858269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:17.858872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:17.859175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:17.859498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:17.869832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:17.870729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:17.880811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1072/2153] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:19.219046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6f05-8368-4d5f-bbc5-a99f36aa8005 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:19.219538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6f05-8368-4d5f-bbc5-a99f36aa8005 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:19.219786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6f05-8368-4d5f-bbc5-a99f36aa8005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:19.250328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5a2a6f05-8368-4d5f-bbc5-a99f36aa8005 None None] MFA Rules not processed for user `fc6c463460504af5a2efade9d049216d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:19.251675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a2a6f05-8368-4d5f-bbc5-a99f36aa8005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:19.295124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:19.327686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1082/2154] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:19.338992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:19.341406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:19.402370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0556-90b4-4cee-a315-f5fe23a4349a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:19.406068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:19.406665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:19.406945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:19.407257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:19.416486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:19.418383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:19.428651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1073/2155] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:22.213594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db68f6-d09a-4811-a611-2c77162ee844 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:22.214198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db68f6-d09a-4811-a611-2c77162ee844 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:22.214353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db68f6-d09a-4811-a611-2c77162ee844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:22.233962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-15db68f6-d09a-4811-a611-2c77162ee844 None None] MFA Rules not processed for user `fc6c463460504af5a2efade9d049216d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:22.235210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15db68f6-d09a-4811-a611-2c77162ee844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:22.242830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1083/2156] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:28.107890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:28.109424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:28.123475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f236-c6d1-42f2-bf71-9c43e557c71f service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:28.128338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:28.128969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:28.129255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:28.129534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] PATH_INFO: `/v3/users/354180699c574605ae66cfa798408cdb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:28.130665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354180699c574605ae66cfa798408cdb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:28.132645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:28.317392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354180699c574605ae66cfa798408cdb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:28.318008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354180699c574605ae66cfa798408cdb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:28.318637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354180699c574605ae66cfa798408cdb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:28.327457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354180699c574605ae66cfa798408cdb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:28.343071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354180699c574605ae66cfa798408cdb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:28.410534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1074/2157] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:47:28 2022] DELETE /identity/v3/users/354180699c574605ae66cfa798408cdb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:28.418480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:28.420183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:28.424348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:28.462464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:28.463839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:28.534430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1084/2158] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:28.545411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:28.546878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:28.580689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:28.606728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75123c9-3f09-4fa8-9c98-ba5e37744519 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:28.611279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:28.611760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:28.612037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:28.612306 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:28.622489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:28.623972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83da2b-7110-41f8-80c8-78354c5a8785 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:28.633803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1075/2159] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:29.041675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.043320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:29.056590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6e209-9733-4c57-89d7-efebc6599712 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.061458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.062194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.062539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.062877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] PATH_INFO: `/v3/projects/40eb4dbb350a44ff874104eba585aa8d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.067220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40eb4dbb350a44ff874104eba585aa8d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.067220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.180001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40eb4dbb350a44ff874104eba585aa8d', 'request_id': 'req-b5a22e95-4f96-46b9-9717-b72f8e89b52c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:29.187343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40eb4dbb350a44ff874104eba585aa8d', 'request_id': 'req-b5a22e95-4f96-46b9-9717-b72f8e89b52c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:29.194651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40eb4dbb350a44ff874104eba585aa8d', 'request_id': 'req-b5a22e95-4f96-46b9-9717-b72f8e89b52c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:29.260111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] The token cache is being invalidate because project 40eb4dbb350a44ff874104eba585aa8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:29.260532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:29.261397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b5a22e95-4f96-46b9-9717-b72f8e89b52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:29.264435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1085/2160] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:29 2022] DELETE /identity/v3/projects/40eb4dbb350a44ff874104eba585aa8d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:47:29.269844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.270239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.270514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.296551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:29.298080 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:29.384199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1076/2161] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:29.395044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.395441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.395717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.430589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:29.433630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:29.443122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1086/2162] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:29.449008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.461553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdc9a6-dbd0-443f-96c2-2974479baff9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.467832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.474400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.488034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1077/2163] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:29.492955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.505582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179195b0-072d-4d87-bf63-71c4852ee5f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.512077 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.512712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.513061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.513410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.514854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.516209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.648107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1087/2164] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:29 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:29.649650 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.661414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936c7c-835e-4d81-83f6-06348c42d77e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.734799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.735817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.736107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.736386 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.737027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.739130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.820726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1078/2165] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:29 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:29.822111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.849052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57407c-9fb1-4318-bb91-4af70e7a1d3a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.856180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.857393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.857775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.858127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.858919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.861636 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.878648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1088/2166] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:47:29.880218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.893023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8827c3-5071-4421-9187-f5bc95555bbe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.899262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.900093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.900347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.900813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:29.901729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:29.904071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a808-0f61-40aa-b295-d73077b7a674 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:29.919129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1079/2167] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:29.923590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:29.938967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b6b11-6dd2-44d6-93ff-68b6caaf77f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:29.960738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:29.961707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:29.962098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:29.963307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] PATH_INFO: `/v3/projects/1e05262c7ade42589aaa5e2cf9a85aee/users/dda12aeafac2429dbf7136231d24609a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:30.011107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:30.017451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e05262c7ade42589aaa5e2cf9a85aee, user_id=dda12aeafac2429dbf7136231d24609a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:30.020828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:30.109865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1089/2168] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:29 2022] PUT /identity/v3/projects/1e05262c7ade42589aaa5e2cf9a85aee/users/dda12aeafac2429dbf7136231d24609a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:30.114742 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:30.115029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:30.115353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:30.149091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] MFA Rules not processed for user `dda12aeafac2429dbf7136231d24609a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:30.150919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:30.188229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:30.240787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1080/2169] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:30.584744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:30.584744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:30.660070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577701e0-7688-41a9-93b3-bc97497140c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:30.669430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:30.669430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:30.669430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:30.669681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:30.695371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:30.696897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:30.720613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1090/2170] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:40.690081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=15 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:40.704579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:42.002543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:42.006930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:42.079654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e5d1-0467-4358-b6d0-b69f19ba2627 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:42.079654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:42.080039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:42.080139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:42.080373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:42.082317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:42.147352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:42.148798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d6696-0d20-48cd-a59c-830921e3ceb4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:42.158643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1081/2171] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:43.928213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:43.929656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:44.091382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15149e7-3b64-4d2b-ba7b-66595cae8dd3 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:44.097997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:44.098803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:44.099208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:44.099661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:44.101503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:44.117965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:44.119729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:44.133671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1091/2172] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:44.691351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59106dd-0af5-46aa-8fff-7adb196b5d4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:44.691351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59106dd-0af5-46aa-8fff-7adb196b5d4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:44.691351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59106dd-0af5-46aa-8fff-7adb196b5d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:44.712559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b59106dd-0af5-46aa-8fff-7adb196b5d4b None None] MFA Rules not processed for user `5153ddc5d5e4480a81e636fba58821d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:44.714478 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b59106dd-0af5-46aa-8fff-7adb196b5d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:44.789723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1082/2173] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:52.427061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:52.477641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e949f-9e5d-4f08-a301-79ba7a757dd6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:52.478254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e949f-9e5d-4f08-a301-79ba7a757dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:52.478254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e949f-9e5d-4f08-a301-79ba7a757dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:52.508686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-be7e949f-9e5d-4f08-a301-79ba7a757dd6 None None] MFA Rules not processed for user `fc6c463460504af5a2efade9d049216d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:52.509977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be7e949f-9e5d-4f08-a301-79ba7a757dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:52.520597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a0ad8-77ba-4c10-b2f2-1f302e93a47e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:52.525946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:52.526935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:52.529792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:52.530089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] PATH_INFO: `/v3/users/dda12aeafac2429dbf7136231d24609a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:52.531876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda12aeafac2429dbf7136231d24609a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:52.534455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:52.600393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:52.611981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1083/2174] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:52.750756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda12aeafac2429dbf7136231d24609a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:52.751513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda12aeafac2429dbf7136231d24609a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:52.752122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda12aeafac2429dbf7136231d24609a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:52.759476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda12aeafac2429dbf7136231d24609a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:52.821427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda12aeafac2429dbf7136231d24609a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:52.841368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1092/2175] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:47:52 2022] DELETE /identity/v3/users/dda12aeafac2429dbf7136231d24609a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:52.846096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:52.846665 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:52.846946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:52.867162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:52.868300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:52.932333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1084/2176] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:52.942721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:52.944184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:52.956302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:53.009186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0aeb-42fb-4ba5-af3d-f72663e9a29c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:53.013002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:53.013676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:53.013918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:53.014204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:53.026484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:53.029638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0345dc-6d97-4353-95a9-d81d0de49e36 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:53.047179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1093/2177] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:53.588743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:53.591767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:53.614440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53476-5022-4aff-8a70-5f4a05980563 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:53.619259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:53.619912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:53.620307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:53.620440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] PATH_INFO: `/v3/projects/1e05262c7ade42589aaa5e2cf9a85aee` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:53.621640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e05262c7ade42589aaa5e2cf9a85aee)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:53.624243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:53.742760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e05262c7ade42589aaa5e2cf9a85aee', 'request_id': 'req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:53.749323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e05262c7ade42589aaa5e2cf9a85aee', 'request_id': 'req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:53.821546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e05262c7ade42589aaa5e2cf9a85aee', 'request_id': 'req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:53.834748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] The token cache is being invalidate because project 1e05262c7ade42589aaa5e2cf9a85aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:53.835044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:53.836055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33d4ecfa-fbd5-4a82-bf31-022928d59dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:53.837571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1085/2178] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:53 2022] DELETE /identity/v3/projects/1e05262c7ade42589aaa5e2cf9a85aee => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:47:53.843665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:53.844159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:53.844366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:53.866405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:53.866660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:53.947828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1094/2179] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:53.956866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:53.957147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:53.957416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:53.978150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:53.979343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:53.987811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1086/2180] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:53.992747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.003215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f53c1-f83c-47d1-8489-cc5736725546 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.007967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.008639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.008921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.013214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.013214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:47:54.013214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.013214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.028876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1095/2181] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:47:54.030494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.040704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d7ad-86a9-4e09-a127-a8018a15b664 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.045963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.046637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.046995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.047377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.047933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.049891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.125651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1087/2182] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:54.130126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.141368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4491bd5-8cf9-4a77-b991-15c38f6d7ac8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.202281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.202898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.203207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.203482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.204109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.206070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.301763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1096/2183] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:47:54 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:47:54.305720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.317204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b9a3-2dd5-4bb7-a991-6dbc875188b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.322117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.322724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.323004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.323307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.323961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.326307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.336863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1088/2184] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:54.341084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.351960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7eb5c-92b1-4efa-8aa0-dd38d9f3df55 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.357794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.357794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.358032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.358340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.358990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.360625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1559259-2f1a-4115-8bbb-b7d888ac8298 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.379280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1097/2185] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:47:54.381118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.392972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ff6b7-aa58-448f-8263-0ce18bee5b57 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.397738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.398398 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.403841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.403841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] PATH_INFO: `/v3/projects/41d01766e4a0491db94718a2608964b1/users/420eb391bad94805a28a969085295d5f/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.415027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d01766e4a0491db94718a2608964b1, user_id=420eb391bad94805a28a969085295d5f, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.418096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.496803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1089/2186] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:47:54 2022] PUT /identity/v3/projects/41d01766e4a0491db94718a2608964b1/users/420eb391bad94805a28a969085295d5f/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:54.511121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.511402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.511653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.550381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] MFA Rules not processed for user `420eb391bad94805a28a969085295d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:54.551569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:54.557070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:54.666335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1098/2187] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:47:54.678271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:54.680132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:54.703070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:54.738596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15708105-7c51-4d9e-ac1a-584121399905 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:54.742238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dd913-5859-498c-9935-3820019da90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:54.743117 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dd913-5859-498c-9935-3820019da90c service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:54.743404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dd913-5859-498c-9935-3820019da90c service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:54.743677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dd913-5859-498c-9935-3820019da90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:54.752479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dd913-5859-498c-9935-3820019da90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:54.753832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dd913-5859-498c-9935-3820019da90c service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:54.762504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1090/2188] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:58.628973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:58.698274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7fdbc-987a-4d63-9c1f-9a63c1348968 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:58.703604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:58.704268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:58.704545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:58.704817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] PATH_INFO: `/v3/users/420eb391bad94805a28a969085295d5f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:58.705939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420eb391bad94805a28a969085295d5f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:58.707890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:58.899640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420eb391bad94805a28a969085295d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:58.901197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420eb391bad94805a28a969085295d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:58.901880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420eb391bad94805a28a969085295d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:58.910458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420eb391bad94805a28a969085295d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:58.969599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420eb391bad94805a28a969085295d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:58.989908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1099/2189] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:47:58 2022] DELETE /identity/v3/users/420eb391bad94805a28a969085295d5f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:47:58.994583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:58.995172 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:58.995270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:59.017785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:59.019201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:59.092457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1091/2190] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:47:59.103928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:59.105352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:59.145975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:59.182018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b6cf2-8dfa-4a09-ab89-0fc3c09085e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:59.183924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:59.184606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:59.184977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:59.185319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:59.195354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:59.196880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc4390-8f45-48a6-80ae-23b6f56956dc service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:59.208589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1100/2191] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:47:59.641031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:47:59.643048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:47:59.663801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9615db-392b-462c-b09d-2ac2e8cb4d82 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:47:59.676711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:47:59.677435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:59.677730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:59.678018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] PATH_INFO: `/v3/projects/41d01766e4a0491db94718a2608964b1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:59.679372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d01766e4a0491db94718a2608964b1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:47:59.681684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:47:59.784524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d01766e4a0491db94718a2608964b1', 'request_id': 'req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:59.791100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d01766e4a0491db94718a2608964b1', 'request_id': 'req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:59.878595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d01766e4a0491db94718a2608964b1', 'request_id': 'req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:59.893375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] The token cache is being invalidate because project 41d01766e4a0491db94718a2608964b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:47:59.893680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:59.894772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb795a74-eef9-4dd1-9af2-0fc0fd65ca3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:47:59.896056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1092/2192] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:47:59 2022] DELETE /identity/v3/projects/41d01766e4a0491db94718a2608964b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:47:59.901117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:47:59.901635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:47:59.901879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:47:59.924752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:47:59.926230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:00.004227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1101/2193] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:00.013618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.014114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.020103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.037149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:00.038473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:00.051055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1093/2194] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:00.052295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.063640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51806-bd86-4e63-b115-850ec4206ce7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.068645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.069259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.069539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.069811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.071634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:48:00.071634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.072371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.085022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1102/2195] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:48:00.089565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.099639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dec2e-0aef-4a0c-ab5c-82fc7c8c6b01 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.104526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.105109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.105387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.105711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.106346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.109262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.183886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1094/2196] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:48:00.187954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.207390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0415fe-8716-40d2-87af-5d0a3ed204ef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.287830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.288527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.288861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.289142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.289812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.292216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.363968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1103/2197] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:48:00 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:48:00.368569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.391013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc673-c13e-40b8-9755-de0de736da95 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.397209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.398070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.398360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.398641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.399352 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.400972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.413705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1095/2198] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:48:00.417985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.438216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cbd50-ecdf-41ea-8ec3-c98e5cab405c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.449355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.449720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.450016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.450292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.450963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.452694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288344-c690-45b6-8365-5d38abb5c18a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.492715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1104/2199] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:48:00.494066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.505278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a8bc-32a1-4ae8-a417-689cc2ac3319 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.516799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.517921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.518409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.518883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] PATH_INFO: `/v3/projects/0c7d1a8ad2c14405b1e1a62d0848b275/users/d639e1a498124c0ab7da9b899e61c452/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.525047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:00.546433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7d1a8ad2c14405b1e1a62d0848b275, user_id=d639e1a498124c0ab7da9b899e61c452, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.549492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.666881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1096/2200] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:48:00 2022] PUT /identity/v3/projects/0c7d1a8ad2c14405b1e1a62d0848b275/users/d639e1a498124c0ab7da9b899e61c452/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:48:00.674280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9235e0-661a-4bdd-b885-c408f4ff642c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.674631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9235e0-661a-4bdd-b885-c408f4ff642c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.674840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9235e0-661a-4bdd-b885-c408f4ff642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.697025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f9235e0-661a-4bdd-b885-c408f4ff642c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:00.698312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f9235e0-661a-4bdd-b885-c408f4ff642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:00.736098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:00.767024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1105/2201] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:00.776996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:00.778708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:00.843538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc62c37-2514-4ffd-b98d-d9d9f46b1adc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:00.847004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:00.847656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:00.847938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:00.848317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:00.859637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:00.862068 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:00.872736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1097/2202] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:02.423867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d828-7bca-4193-b606-f1581ada3459 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:02.424432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d828-7bca-4193-b606-f1581ada3459 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:02.424432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d828-7bca-4193-b606-f1581ada3459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:02.455785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5e39d828-7bca-4193-b606-f1581ada3459 None None] MFA Rules not processed for user `d639e1a498124c0ab7da9b899e61c452`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:02.457079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e39d828-7bca-4193-b606-f1581ada3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:02.527360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1106/2203] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:02.539377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:02.540815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:02.604791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d243e-11bb-4b29-a472-480f6dc4a9d5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:02.610394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:02.611153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:02.611532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:02.611904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:02.620717 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:02.622266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f9d9-b8c6-4fb3-9f99-f965dda35eb3 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:02.631990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1098/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:04.319015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:04.319550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:04.319647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:04.338876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] MFA Rules not processed for user `d639e1a498124c0ab7da9b899e61c452`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:04.340145 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:04.347073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1107/2205] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:05.250039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e5a-02e2-43e8-bc39-0d3cc881be29 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:05.250536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e5a-02e2-43e8-bc39-0d3cc881be29 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:05.250765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e5a-02e2-43e8-bc39-0d3cc881be29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:05.271191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd567e5a-02e2-43e8-bc39-0d3cc881be29 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:05.272428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd567e5a-02e2-43e8-bc39-0d3cc881be29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:05.348265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1099/2206] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:48:05.423870 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:05.426580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:05.550597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2719d-4cbc-4028-a2a7-89e6abc6ac89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:05.556092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:05.556799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:05.557149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:05.557512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:05.567447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:05.569266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:05.578014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1108/2207] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:48:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:15.340591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:15.574361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:23.491513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6141-5b54-4a80-b5e5-c97216f860bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:23.492035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6141-5b54-4a80-b5e5-c97216f860bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:23.492132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6141-5b54-4a80-b5e5-c97216f860bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:23.513962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee3a6141-5b54-4a80-b5e5-c97216f860bb None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:23.515428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee3a6141-5b54-4a80-b5e5-c97216f860bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:23.527878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1100/2208] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:23.549228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:23.560305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb8ff7-064f-4bc0-9534-3d6aea3ce021 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:23.570779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:23.571744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:23.572076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:23.572528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:23.590746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:23.592676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2436e-c379-45b0-b52e-c2ede51d60f4 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:23.602294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1109/2209] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:26.056198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.057099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.059710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.061355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1101/2210] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:48:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:48:26.072554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a19c1-831d-40f9-be43-22f34ebe076d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.073384 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a19c1-831d-40f9-be43-22f34ebe076d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.073959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a19c1-831d-40f9-be43-22f34ebe076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.119236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1e7a19c1-831d-40f9-be43-22f34ebe076d None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:26.121174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e7a19c1-831d-40f9-be43-22f34ebe076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:26.302345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1110/2211] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:26.337429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:26.344015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:26.467479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eadc68-b4f1-4d72-8557-5543def2161d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:26.472079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:26.475049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.475049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.475049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.490834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:26.494370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb297a-40dd-4418-86bd-1632534c9dbc service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:26.505932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1102/2212] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:26.768356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb487a-6997-4cf7-b878-d828cc0e895b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.776842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb487a-6997-4cf7-b878-d828cc0e895b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.776842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb487a-6997-4cf7-b878-d828cc0e895b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.776842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1111/2213] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:48:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:48:26.781825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a188-8a0b-4cde-89d5-3e8658f2c11c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.782296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a188-8a0b-4cde-89d5-3e8658f2c11c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.782772 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a188-8a0b-4cde-89d5-3e8658f2c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.824750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-57c2a188-8a0b-4cde-89d5-3e8658f2c11c None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:26.825909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57c2a188-8a0b-4cde-89d5-3e8658f2c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:26.833995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1103/2214] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:26.846956 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb487a-6997-4cf7-b878-d828cc0e895b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:26.858413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb487a-6997-4cf7-b878-d828cc0e895b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:26.862540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:26.863245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.863524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.863796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.871480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:26.873248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff87e5-4a19-4575-9117-da37923b219d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:26.882866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1112/2215] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:26.973666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.974085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.974421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:26.975822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1104/2216] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:48:26.981658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64abad-7d68-4dfe-bf9c-a5833489bf4d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:26.985263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64abad-7d68-4dfe-bf9c-a5833489bf4d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:26.985263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64abad-7d68-4dfe-bf9c-a5833489bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:27.011721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2a64abad-7d68-4dfe-bf9c-a5833489bf4d None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:27.018028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a64abad-7d68-4dfe-bf9c-a5833489bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:27.038188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1113/2217] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:27.048223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:27.049971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:27.071504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc12d3a-b9e3-45b2-bbb2-13c236a1b1ad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:27.085410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:27.086365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:27.086877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:27.087417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:27.099611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:27.101453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:27.119345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1105/2218] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:37.002631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=46 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:37.108979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=38 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:44.254900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ea2-67c6-472d-99aa-65534b2cc8c0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:44.255482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ea2-67c6-472d-99aa-65534b2cc8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:44.255586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ea2-67c6-472d-99aa-65534b2cc8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:44.277879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0b5a2ea2-67c6-472d-99aa-65534b2cc8c0 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:44.279299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b5a2ea2-67c6-472d-99aa-65534b2cc8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:44.287642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1114/2219] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:48:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:44.307385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:44.319313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0618ad-883e-495e-96ff-d3f7cafedc1c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:44.325274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:44.325890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:44.326220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:44.326704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:44.337355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:44.338956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:44.348438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1106/2220] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:48.260332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850b2d-e4a6-454e-a106-f7181a74917b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:48.260992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850b2d-e4a6-454e-a106-f7181a74917b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:48.260992 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850b2d-e4a6-454e-a106-f7181a74917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:48.282904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f8850b2d-e4a6-454e-a106-f7181a74917b None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:48.284434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8850b2d-e4a6-454e-a106-f7181a74917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:48.293080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1115/2221] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:48.306109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:48.317147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc577e1e-6063-467d-b57f-92b87c42b24e service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:48.329135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:48.329752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:48.330035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:48.330310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:48.340107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:48.342036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e0e9a-50ed-4e29-8e44-76668b5b883d service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:48.352393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1107/2222] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:53.020869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:53.021547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:53.021891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:53.023440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1116/2223] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:48:53.028727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:53.029340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:53.029552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:53.057189 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] MFA Rules not processed for user `f1b1de8ca7b349ad98880b604d1cb6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:53.059314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:53.144006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1108/2224] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:48:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:53.155965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:53.158613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:53.168610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:53.171754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:53.186543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a8aa-3cd1-4513-8210-d5a96d63b397 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:53.192867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:53.203480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:53.203858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:53.204372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:53.205241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c714-a703-4477-8c81-cb00523f46c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:53.211152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:53.211891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:53.212265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:53.212614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] PATH_INFO: `/v3/users/fc6c463460504af5a2efade9d049216d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:53.213894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6c463460504af5a2efade9d049216d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:53.214830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:53.216166 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:53.216617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:53.228242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1117/2225] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:48:53.546012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6c463460504af5a2efade9d049216d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:53.546751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6c463460504af5a2efade9d049216d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:53.547382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6c463460504af5a2efade9d049216d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:53.555837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6c463460504af5a2efade9d049216d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:53.573603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-693251f6-2f99-46fb-a534-ac0d7c701513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6c463460504af5a2efade9d049216d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:53.632816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1109/2226] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:48:53 2022] DELETE /identity/v3/users/fc6c463460504af5a2efade9d049216d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:48:53.880222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:53.892185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6f50-637b-486b-bbff-f6395f8f9ebd service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:53.966799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:53.968858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:53.968858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:53.969232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] PATH_INFO: `/v3/projects/87c8d59385d842209fe2f28ea800ee57` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:53.970417 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c8d59385d842209fe2f28ea800ee57)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:53.972524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.098005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c8d59385d842209fe2f28ea800ee57', 'request_id': 'req-102e58fc-b4cb-4852-aed9-08a8e064248c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:54.104235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c8d59385d842209fe2f28ea800ee57', 'request_id': 'req-102e58fc-b4cb-4852-aed9-08a8e064248c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:54.115897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c8d59385d842209fe2f28ea800ee57', 'request_id': 'req-102e58fc-b4cb-4852-aed9-08a8e064248c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:54.174967 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] The token cache is being invalidate because project 87c8d59385d842209fe2f28ea800ee57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:48:54.175219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:54.175860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-102e58fc-b4cb-4852-aed9-08a8e064248c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:48:54.177553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1118/2227] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:48:53 2022] DELETE /identity/v3/projects/87c8d59385d842209fe2f28ea800ee57 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:48:54.182489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.183055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.183223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.204945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:54.206251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:54.249320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:54.271808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1110/2228] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:54.281093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.281452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.281731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.303957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:54.305025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:54.313416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1119/2229] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:54.317745 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.328801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1e4f2-50d5-4312-8645-61c80dcbc6d9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.333995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.334643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.334918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.335230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.335910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:48:54.336392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.338059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.352700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1111/2230] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:48:54.357259 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.369079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43203-8490-49b2-ad13-a21b65192451 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.373993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.374611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.374980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.375198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.375840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.377839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.457191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1120/2231] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:48:54 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:48:54.458287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.469990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4279-cec6-4b69-a55e-00995a36d369 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.608753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.609723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.610186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.610640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.611844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.615474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.708243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1112/2232] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:48:54 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:48:54.712492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.724254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9d91-c9b8-460b-9dec-59e2f821baa8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.729347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.730745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.730745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.730745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.731158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.732771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.744770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1121/2233] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:48:54.749730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.763811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766522-394c-4c33-869c-dcba20d39362 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.770145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.770855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.771241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.771542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.772183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.773802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2735ef-a291-4013-a59e-1e7990bca730 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.785836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1113/2234] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:48:54.790306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:54.801685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2b4e-5e88-4293-981e-fdc9fb84e39b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:54.806597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:54.807419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.807764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.808244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] PATH_INFO: `/v3/projects/4049b172ef7741a1ad0fce51e3200d65/users/b2bd0179acb84d23badd3705e85b9edf/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.824850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4049b172ef7741a1ad0fce51e3200d65, user_id=b2bd0179acb84d23badd3705e85b9edf, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:54.828270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:54.875150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:54.880208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1122/2235] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:48:54 2022] PUT /identity/v3/projects/4049b172ef7741a1ad0fce51e3200d65/users/b2bd0179acb84d23badd3705e85b9edf/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:48:54.892638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f6abe-5ff2-4a3f-b048-dee246c0d291 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:54.897222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f6abe-5ff2-4a3f-b048-dee246c0d291 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:54.897222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f6abe-5ff2-4a3f-b048-dee246c0d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:54.928032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b65f6abe-5ff2-4a3f-b048-dee246c0d291 None None] MFA Rules not processed for user `b2bd0179acb84d23badd3705e85b9edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:48:54.931114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b65f6abe-5ff2-4a3f-b048-dee246c0d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:55.011254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1114/2236] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:48:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:48:55.020154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:48:55.021896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:48:55.122842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497ba7-85f4-44e4-bb96-9dcddc845f87 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:48:55.130496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:48:55.131558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:48:55.132032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:48:55.132486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:48:55.146642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:48:55.149350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:48:55.168819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1123/2237] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:48:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:05.005185 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:05.158780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=26 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:13.473958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822ef4d-ba3f-4d7f-a909-5ccdcc8821ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:13.474827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822ef4d-ba3f-4d7f-a909-5ccdcc8821ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:13.475244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822ef4d-ba3f-4d7f-a909-5ccdcc8821ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:13.497317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e822ef4d-ba3f-4d7f-a909-5ccdcc8821ab None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:13.498875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e822ef4d-ba3f-4d7f-a909-5ccdcc8821ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:13.579022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1115/2238] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:13.600873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:13.602625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:13.692698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c487-fd73-4647-8060-7e41d5bebc53 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:13.698794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:13.699547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:13.699832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:13.700115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:13.710241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:13.711907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:13.724534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1124/2239] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:15.629967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d67f-0f42-4df4-8b4f-42d04953af4d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:15.630774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d67f-0f42-4df4-8b4f-42d04953af4d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:15.630774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d67f-0f42-4df4-8b4f-42d04953af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:15.652453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e376d67f-0f42-4df4-8b4f-42d04953af4d None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:15.653794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e376d67f-0f42-4df4-8b4f-42d04953af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:15.723380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1116/2240] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:49:15.750893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:15.753147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:15.860889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1832fbd-aa62-4696-801f-f1112ce9beff service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:15.866674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:15.872082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:15.872082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:15.872082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:15.879689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:15.881480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:15.894853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1125/2241] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:20.014085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a70f-9bd6-4881-9cf0-3fa6417a2ba2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:20.014988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a70f-9bd6-4881-9cf0-3fa6417a2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:20.014988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a70f-9bd6-4881-9cf0-3fa6417a2ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:20.041450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4431a70f-9bd6-4881-9cf0-3fa6417a2ba2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:20.042914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4431a70f-9bd6-4881-9cf0-3fa6417a2ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:20.053363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1117/2242] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:20.073392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:20.075194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:20.093262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baa9c-4f48-474a-ac1f-36b096647240 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:20.099730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:20.100385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:20.100650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:20.100926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:20.110926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:20.112854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:20.127649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1126/2243] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:24.579061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:24.579821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:24.579821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:24.605073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:24.606415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:24.615347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1118/2244] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:24.632656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:24.646321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086977c-67b1-4dc9-aafd-f8cbdafaf997 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:24.652624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:24.653428 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:24.653982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:24.654471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:24.664575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:24.666444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15778-823b-4e89-9b68-4045f245561c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:24.678386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1127/2245] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:27.819052 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:27.826339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf676020-4bf8-4bbf-b59f-f92b55813e65 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:27.833866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:27.834837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:27.835392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:27.835909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] PATH_INFO: `/v3/users/b2bd0179acb84d23badd3705e85b9edf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:27.837903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bd0179acb84d23badd3705e85b9edf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:27.840668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:28.145013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bd0179acb84d23badd3705e85b9edf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:28.146562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bd0179acb84d23badd3705e85b9edf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:28.147952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bd0179acb84d23badd3705e85b9edf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:28.165885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bd0179acb84d23badd3705e85b9edf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:28.190314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bd0179acb84d23badd3705e85b9edf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:28.337668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1119/2246] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:49:27 2022] DELETE /identity/v3/users/b2bd0179acb84d23badd3705e85b9edf => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:49:28.340326 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55946-595b-47ff-8945-c98f97508efc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:28.341645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55946-595b-47ff-8945-c98f97508efc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:28.341821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55946-595b-47ff-8945-c98f97508efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:28.363548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-01b55946-595b-47ff-8945-c98f97508efc None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:28.366971 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-01b55946-595b-47ff-8945-c98f97508efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:28.421478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:28.449592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1128/2247] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:28.465135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:28.468585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:28.475756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:28.477142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:28.477602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:28.480689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:28.508589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:28.510488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:28.525302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1129/2248] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:28.545087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:28.546913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:28.585364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3e6bb-b9b1-4f81-9b5d-4b459dc32c2f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:28.596595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:28.597639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:28.598124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:28.598684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:28.621101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:28.625016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:28.646457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1120/2249] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:28.677231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2931-4a0a-4012-bec3-c0b43a3d7d17 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:28.688489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:28.689423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:28.689867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:28.690367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:28.708581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:28.711720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c6f3-1fda-4df9-8310-550e7b571494 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:28.739325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1130/2250] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:49:29.154810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:29.156594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:29.182451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7cd6-ff83-4ccf-8c0a-a3c1aad51602 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:29.193903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:29.193903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:29.194320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:29.194886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] PATH_INFO: `/v3/projects/4049b172ef7741a1ad0fce51e3200d65` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:29.196981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4049b172ef7741a1ad0fce51e3200d65)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:29.199643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:29.368996 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4049b172ef7741a1ad0fce51e3200d65', 'request_id': 'req-987076e5-e58b-4426-bab6-47aa36511ebc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:29.381652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4049b172ef7741a1ad0fce51e3200d65', 'request_id': 'req-987076e5-e58b-4426-bab6-47aa36511ebc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:29.495145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4049b172ef7741a1ad0fce51e3200d65', 'request_id': 'req-987076e5-e58b-4426-bab6-47aa36511ebc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:29.512484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] The token cache is being invalidate because project 4049b172ef7741a1ad0fce51e3200d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:49:29.513133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:29.514078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:49:29.516038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1121/2251] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:49:29 2022] DELETE /identity/v3/projects/4049b172ef7741a1ad0fce51e3200d65 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:49:33.845706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:33.846366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:33.846828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:33.873689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:33.875116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:33.948849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1131/2252] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:33.973483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:33.974954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:34.064126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987076e5-e58b-4426-bab6-47aa36511ebc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:34.070042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:34.070747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:34.071029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:34.071336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:34.080710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:34.082327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:34.094003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1122/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:36.186240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:36.187959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:36.258496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64fa7-5af8-4f34-878c-dba0d5ec7e8a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:36.262637 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:36.263809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:36.264091 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:36.264370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:36.266473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:36.282097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:36.283631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0ba99-263f-48be-8b65-77d451498420 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:36.296609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1132/2254] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:39.174658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:39.176640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:39.198265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:39.229009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:39.229885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:39.230483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:39.241313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d9dd-1710-44ab-ad81-c3d15c260702 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:39.245257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:39.245887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:39.246271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:39.246447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:39.249901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:39.252609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:39.252609 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:39.261308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1133/2255] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:49:39.268226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:39.268226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:39.280449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1123/2256] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:39.385518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:39.387285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:39.399333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:39.405238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183666f-6153-4554-9dcc-ccf6cf0c058c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:39.411284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:39.412018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:39.412297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:39.412565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:39.423739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:39.424480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:39.436283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1134/2257] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:49.334222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=19 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:49.449344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:52.541231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:52.554908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b22a4-9d78-46e7-8720-e0ddd749364f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:52.561549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:52.562265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:52.562547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:52.562821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:52.564811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:52.653627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:52.655502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72ea44-9489-478f-a0a7-ef0222f4954a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:52.666247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1124/2258] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:49:57.582516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:49:57.594475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cafb79-6437-41b3-a651-07b28d0a0d6c service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:49:57.602461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:49:57.603140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:57.603429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:57.603704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:57.605539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:57.670844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:49:57.672554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587cb14-5592-4daa-aac7-81f24f699531 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:49:57.683377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1135/2259] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:49:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:49:57.885731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:49:57.886294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:49:57.886294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:49:57.905899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] MFA Rules not processed for user `5f4abead0b4e4ad9ab6e0bb267e5115e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:49:57.907242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:49:57.914313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1125/2260] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:02.610442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:02.611042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:02.611042 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:02.631028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] MFA Rules not processed for user `d639e1a498124c0ab7da9b899e61c452`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:02.632296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:02.695201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1136/2261] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:02.948857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:02.960499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d1e17-2a04-46b6-86ab-42ea36fdb963 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:02.964065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:02.964675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:02.964955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:02.965535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:02.967218 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:02.977597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:02.979051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:02.989055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1126/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:03.501165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:03.503580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:03.612903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba150-bbd1-4580-a37b-5413f62023f3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:03.618420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:03.619211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:03.619556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:03.619836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:03.622263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:03.636617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:03.639457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:03.651647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1137/2263] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:08.244958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:08.259506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419d84-2325-4771-b317-c970e6bb368d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:08.265508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:08.266133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:08.266421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:08.266699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:08.268824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:08.355067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:08.357747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:08.371666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1127/2264] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:12.203647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:12.206100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:12.226672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc135c4-3e2a-4ed2-baf3-0307c4ce7f18 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:12.231905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:12.235271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:12.235271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:12.235271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:12.236451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:12.249285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:12.250786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:12.260649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1138/2265] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:18.365223 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=65 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:22.256183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:25.714245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:25.735353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc71f0-9165-4155-9e11-19c47de24d84 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:25.746342 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:25.747734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:25.748033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:25.748325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:25.750998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:25.766515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:25.768529 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9c21-9cf0-4a6f-aeb5-d45e0a584245 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:25.801897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1128/2266] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:26.036408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:26.051225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99c78-9ae3-44bc-93bf-dc0398d0db01 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:26.065414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:26.066089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:26.066369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:26.066643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:26.068702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:26.150465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:26.153559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:26.168543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1139/2267] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:30.010777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183e07-a644-4f3c-97af-df0ad37b9dad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:30.011347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183e07-a644-4f3c-97af-df0ad37b9dad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:30.011453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183e07-a644-4f3c-97af-df0ad37b9dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:30.040296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c0183e07-a644-4f3c-97af-df0ad37b9dad None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:30.043296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0183e07-a644-4f3c-97af-df0ad37b9dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:30.052484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1129/2268] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:30.069994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:30.082489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a264016-46ef-423c-b407-2d4d5f775e98 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:30.088849 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:30.092281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:30.092281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:30.092281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:30.101381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:30.103013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:30.116130 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1140/2269] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:32.354354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894454c-8780-4e19-9be1-e64be998984f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:32.354943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894454c-8780-4e19-9be1-e64be998984f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:32.354943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894454c-8780-4e19-9be1-e64be998984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:32.374751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6894454c-8780-4e19-9be1-e64be998984f None None] MFA Rules not processed for user `5153ddc5d5e4480a81e636fba58821d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:32.376084 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6894454c-8780-4e19-9be1-e64be998984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:32.383195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1130/2270] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:32.712605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:32.722666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8bd1-a837-4cc1-afe8-fbdf60587fb1 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:32.726414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:32.727016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:32.727317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:32.727588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:32.729389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:32.740373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:32.741787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:32.750547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1141/2271] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:35.793601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4d9-5cdc-447b-a2b2-0667a7bcabcd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:35.795454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4d9-5cdc-447b-a2b2-0667a7bcabcd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:35.795845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4d9-5cdc-447b-a2b2-0667a7bcabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:35.817931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1e2ae4d9-5cdc-447b-a2b2-0667a7bcabcd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:35.820055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1e2ae4d9-5cdc-447b-a2b2-0667a7bcabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:35.831300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1131/2272] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:35.846620 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:35.864108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271881-7ed5-4d47-839b-e8a8d384608a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:35.869267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:35.870358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:35.870358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:35.870358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:35.880398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:35.882238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:35.900975 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1142/2273] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:39.640976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6278-a750-4787-be5d-65a2815742ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:39.641458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6278-a750-4787-be5d-65a2815742ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:39.641590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6278-a750-4787-be5d-65a2815742ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:39.670183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-61cb6278-a750-4787-be5d-65a2815742ec None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:39.671805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61cb6278-a750-4787-be5d-65a2815742ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:39.680514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1132/2274] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:39.695969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:39.709103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1ca1-d063-4925-8414-c40e707d4693 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:39.714968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:39.715690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:39.716514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:39.716785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:39.726388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:39.728365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42575e-8bf1-4def-a1f0-4bac529b18dd service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:39.740190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1143/2275] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:42.013483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:42.016995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:42.016995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:42.034965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] MFA Rules not processed for user `e126e83baeee403f9d8f0ca39a75bb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:42.036280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:42.043573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1133/2276] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:46.088028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:46.088724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:46.089164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:46.113045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:46.114372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:46.123921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1144/2277] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:50:46.140819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:46.185760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fb290-467b-416c-b9c9-5004fdd19609 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:46.189513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:46.193944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:46.197507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:46.197507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:46.197507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:46.205160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffec8ed-efd5-47b7-96a9-ef1701e07eab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:46.210146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:46.211949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:46.212202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354042c-c4fb-4063-a743-f95a0a28a085 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:46.213073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:46.213330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:46.213742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:46.216703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:46.229682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1134/2278] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:46.233427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:46.235463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:46.263154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1145/2279] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:53.525347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:53.525895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:53.525895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:53.535785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=28 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:53.551577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:50:53.553856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:53.569884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1135/2280] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Aug 24 17:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:50:53.587773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:53.598947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=62 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:53.610756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3ea8-386e-4e75-9168-81d438f3b146 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:53.622570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:53.622570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:53.622982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:53.623525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:53.640122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:53.643355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f3069-2cf9-4e63-8f38-88f07e607e7f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:53.659058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1146/2281] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:50:56.235815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:50:56.252216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f6c28-312d-4f84-8ee5-c49f91e9b3aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:50:56.260571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:50:56.262482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:50:56.263069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:50:56.263595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:50:56.267562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:50:56.286863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:50:56.290532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:50:56.308181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1136/2282] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:51:03.757480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:06.300982 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:12.392309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:12.392821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:12.392904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:12.414696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:12.416196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:12.478607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1147/2283] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:12.738436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:12.739917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:12.816000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f0342-81f9-4dc8-b2fd-f0e51286a145 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:12.821021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:12.821638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:12.821922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:12.822193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:12.831663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:12.833715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:12.842482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1137/2284] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:22.471436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=25 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:22.840173 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:24.888149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:24.910789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d9e28-1d94-497f-a00f-d9858b83abef None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:24.919662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:24.920591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:24.921017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:24.921558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:24.924315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:24.944913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:24.947518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:24.965218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1148/2285] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:51:25.058338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:25.061311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:25.090731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eed08-6c46-4f70-8c7c-cdcfb920c951 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:25.097229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:25.098199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:25.098906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:25.099393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] PATH_INFO: `/v3/users/1eb44761a61846d79ea34e6d9b97ac9a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:25.102980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb44761a61846d79ea34e6d9b97ac9a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:25.106433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:25.316373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb44761a61846d79ea34e6d9b97ac9a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:25.318832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb44761a61846d79ea34e6d9b97ac9a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:25.319609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb44761a61846d79ea34e6d9b97ac9a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:25.333768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb44761a61846d79ea34e6d9b97ac9a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:25.353524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb44761a61846d79ea34e6d9b97ac9a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:25.445866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1138/2286] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:51:25 2022] DELETE /identity/v3/users/1eb44761a61846d79ea34e6d9b97ac9a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:25.457198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:25.467459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec5d13-e220-4de4-8eab-388b4212d907 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:25.531739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:25.532567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:25.533128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:25.533474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:25.535771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:25.644852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:25.646338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:25.658306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1149/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:51:26.028678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:26.030974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:26.048461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16550a6-5687-4b40-97d8-c3d63ce410ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:26.054452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:26.054929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:26.055852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:26.055852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] PATH_INFO: `/v3/projects/5ce62c3379954a94b2a1db21132ae345` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:26.056671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce62c3379954a94b2a1db21132ae345)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:26.058820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:26.218188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce62c3379954a94b2a1db21132ae345', 'request_id': 'req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.227812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce62c3379954a94b2a1db21132ae345', 'request_id': 'req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.317256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce62c3379954a94b2a1db21132ae345', 'request_id': 'req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.333947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] The token cache is being invalidate because project 5ce62c3379954a94b2a1db21132ae345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:51:26.334246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.334990 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.336603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1139/2288] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:51:26 2022] DELETE /identity/v3/projects/5ce62c3379954a94b2a1db21132ae345 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:26.342439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:26.354904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fd966-0501-4487-9238-d9d3cf23725f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:26.436496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:26.437667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:26.438132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:26.439219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] PATH_INFO: `/v3/users/e4fc43063cf3438b9fe3c7eaf95d480b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:26.441344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fc43063cf3438b9fe3c7eaf95d480b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:26.445240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:26.709242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:26.716021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fc43063cf3438b9fe3c7eaf95d480b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.716813 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fc43063cf3438b9fe3c7eaf95d480b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.717422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fc43063cf3438b9fe3c7eaf95d480b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.724888 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fc43063cf3438b9fe3c7eaf95d480b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.814980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80692011-faae-4dd1-a25c-a68aaf9c0148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fc43063cf3438b9fe3c7eaf95d480b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:26.845546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1150/2289] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:51:26 2022] DELETE /identity/v3/users/e4fc43063cf3438b9fe3c7eaf95d480b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:27.347644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:27.349355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:27.379032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b7d6b-7f0d-4f42-87ab-7de677fb24dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:27.452411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:27.459876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:27.460545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:27.460844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:27.461115 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] PATH_INFO: `/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:27.462275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c746aaab084d0d9abf64d874a5f0bf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:27.464252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:27.779237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c746aaab084d0d9abf64d874a5f0bf', 'request_id': 'req-30f744bf-557b-4f6b-9c0d-c096de1f9804'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:27.785720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c746aaab084d0d9abf64d874a5f0bf', 'request_id': 'req-30f744bf-557b-4f6b-9c0d-c096de1f9804'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:27.883266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c746aaab084d0d9abf64d874a5f0bf', 'request_id': 'req-30f744bf-557b-4f6b-9c0d-c096de1f9804'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:27.901238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] The token cache is being invalidate because project e3c746aaab084d0d9abf64d874a5f0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:51:27.901938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:27.903064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f744bf-557b-4f6b-9c0d-c096de1f9804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:27.906252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1140/2290] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:51:27 2022] DELETE /identity/v3/projects/e3c746aaab084d0d9abf64d874a5f0bf => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:27.913862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:27.914786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:27.914786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:27.938438 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:27.939930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:28.018475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1151/2291] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:51:28.030653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.031136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.031519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.056659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:28.057932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:28.069969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1141/2292] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:28.077208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.108306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75399ffd-6d62-4a49-9066-bd5161b95bf6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.114439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.115707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.116325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.116565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.117823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:51:28.118372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.122369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.147236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1152/2293] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:51:28.155212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.166303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c2181-2801-44d2-ae1b-178f13cf811e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.172449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.173113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.173395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.173670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.174351 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.176518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.290832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1142/2294] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:51:28 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:28.297858 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.309207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb189f-b54a-46bb-bbb8-7e8af49ecb16 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.376487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.377121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.377452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.377941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.378568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.380616 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.511854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1153/2295] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:51:28 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:28.516783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.528921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4661-4b8d-472c-9ab5-6a04cc6c8e14 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.535237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.537217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.537217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.537217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.537542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.539672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.554107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1143/2296] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:51:28.558573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.577211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e9ef4-6f30-4bfd-ad1b-39d6266d974c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.585551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.586649 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.587019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.587782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.588752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.594577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9acdb-7e7f-493f-94ff-c1e7111b7ad6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.617653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1154/2297] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:51:28.623511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.631532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7e45e-f269-4854-b708-a3affc526ae8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:28.637402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:28.638098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.638379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.638773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] PATH_INFO: `/v3/projects/c7205972d2d344488c139bc2d5621267/users/6d56c325b6d94560bde44328c6690b32/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.658347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7205972d2d344488c139bc2d5621267, user_id=6d56c325b6d94560bde44328c6690b32, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:28.669327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb487c-b567-4896-a645-3472bf356ee3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:28.768821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbdbec-670c-4cd6-bcb2-093f34d90aa9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.769321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbdbec-670c-4cd6-bcb2-093f34d90aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.769801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbdbec-670c-4cd6-bcb2-093f34d90aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.772762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1144/2298] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:51:28 2022] PUT /identity/v3/projects/c7205972d2d344488c139bc2d5621267/users/6d56c325b6d94560bde44328c6690b32/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:28.779667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:28.780148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:28.780639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:28.812679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:28.813013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3fbdbec-670c-4cd6-bcb2-093f34d90aa9 None None] MFA Rules not processed for user `924185a6e69b4e9aa8bcc456c096015e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:28.814482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:28.814789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3fbdbec-670c-4cd6-bcb2-093f34d90aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:28.844780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:28.916785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1145/2299] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:51:28.930715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:28.933212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:28.934881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1155/2300] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:28.985242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:29.031296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5cae4-478c-4ab2-89d0-50200dd6c42a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:29.035674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:29.036263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:29.036557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:29.036852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:29.048837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:29.050606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:29.065846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1146/2301] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:51:37.732471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15644464-7932-406b-9f26-8e0552227980 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:37.735354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15644464-7932-406b-9f26-8e0552227980 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:37.735354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15644464-7932-406b-9f26-8e0552227980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:37.815165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-15644464-7932-406b-9f26-8e0552227980 None None] MFA Rules not processed for user `6d56c325b6d94560bde44328c6690b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:37.818045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15644464-7932-406b-9f26-8e0552227980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:37.990517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1156/2302] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:37.992842 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:38.038685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6417c-ed05-4f34-92de-b33bb3509d71 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:38.068879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:38.070210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:38.070719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:38.071319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:38.072554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:38.082751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:38.240061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1147/2303] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:51:37 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:38.248788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15644464-7932-406b-9f26-8e0552227980 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:38.286104 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15644464-7932-406b-9f26-8e0552227980 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:38.290547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:38.500933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730fe4-0534-4bb0-8c8e-36cb31811e4d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:38.509344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:38.510733 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:38.512711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:38.513378 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:38.527695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:38.581460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:38.582434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:38.592624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:38.593089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:38.594447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:38.598347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:38.649541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:38.654311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:38.671919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1148/2304] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:51:38.731216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1157/2305] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:51:38 2022] POST /identity/v3/users => generated 292 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:38.736969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:38.752337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343c8b-3536-49dd-91a1-7f98a7a5c5a5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:38.760288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:38.762149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:38.762744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:38.763345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:38.764640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:38.767872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:38.788584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1149/2306] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:51:38.794234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:38.805345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80240b91-21c6-40f9-9f38-e6491f016ebe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:38.811489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:38.812757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:38.813122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:38.813437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] PATH_INFO: `/v3/projects/6944fa6d036b44d1bd20180f546f2ed8/users/447a046eb95140f6a84a6692c7c96e8f/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:38.849567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6944fa6d036b44d1bd20180f546f2ed8, user_id=447a046eb95140f6a84a6692c7c96e8f, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:38.857356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:38.993865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1158/2307] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:51:38 2022] PUT /identity/v3/projects/6944fa6d036b44d1bd20180f546f2ed8/users/447a046eb95140f6a84a6692c7c96e8f/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:51:39.001750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:39.025856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127d461-f561-48d2-8f97-9e12f2e04e93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:39.143858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:39.197453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:39.198525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:39.199190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:39.199609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:39.200678 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:39.203548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:39.222874 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1150/2308] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:51:39.236184 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:39.244632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047935-ce4f-4c23-ab25-0aeda352cd6b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:39.254000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:39.255353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:39.256051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:39.256628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] PATH_INFO: `/v3/projects/6944fa6d036b44d1bd20180f546f2ed8/users/447a046eb95140f6a84a6692c7c96e8f/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:39.262400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6944fa6d036b44d1bd20180f546f2ed8, user_id=447a046eb95140f6a84a6692c7c96e8f, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:39.268842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:39.292037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1159/2309] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:51:39 2022] PUT /identity/v3/projects/6944fa6d036b44d1bd20180f546f2ed8/users/447a046eb95140f6a84a6692c7c96e8f/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:41.553814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:41.555967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:41.580167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c7032-4035-4620-9f6f-ed6e9be26463 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:41.734288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:41.735102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:41.735450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:41.735734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] PATH_INFO: `/v3/users/d639e1a498124c0ab7da9b899e61c452` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:41.737083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d639e1a498124c0ab7da9b899e61c452)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:41.739461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:42.041604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd639e1a498124c0ab7da9b899e61c452'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:42.043365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd639e1a498124c0ab7da9b899e61c452'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:42.044394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd639e1a498124c0ab7da9b899e61c452'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:42.054646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd639e1a498124c0ab7da9b899e61c452'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:42.082984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd639e1a498124c0ab7da9b899e61c452'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:42.224828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1151/2310] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:51:41 2022] DELETE /identity/v3/users/d639e1a498124c0ab7da9b899e61c452 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:42.751775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:42.755676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:42.797321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0872-9572-4665-b25b-a1745a19b3ae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:42.812677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:43.016524 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:43.017248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:43.017753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:43.018848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] PATH_INFO: `/v3/projects/0c7d1a8ad2c14405b1e1a62d0848b275` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:43.032237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7d1a8ad2c14405b1e1a62d0848b275)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:43.038741 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:43.187913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7d1a8ad2c14405b1e1a62d0848b275', 'request_id': 'req-bec34d41-dbb5-47ba-b945-b2e7699b359d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:43.197774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7d1a8ad2c14405b1e1a62d0848b275', 'request_id': 'req-bec34d41-dbb5-47ba-b945-b2e7699b359d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:43.211953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7d1a8ad2c14405b1e1a62d0848b275', 'request_id': 'req-bec34d41-dbb5-47ba-b945-b2e7699b359d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:43.318234 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] The token cache is being invalidate because project 0c7d1a8ad2c14405b1e1a62d0848b275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:51:43.318764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:43.320740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:43.326784 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1160/2311] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:51:42 2022] DELETE /identity/v3/projects/0c7d1a8ad2c14405b1e1a62d0848b275 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:47.145841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:47.150099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:47.188268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fdfab-b4d6-4907-893a-a77f6be6ec9a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:47.298287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:47.311326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:47.311793 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:47.312891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:47.313165 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] PATH_INFO: `/v3/users/5f4abead0b4e4ad9ab6e0bb267e5115e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:47.314834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4abead0b4e4ad9ab6e0bb267e5115e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:47.316889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:47.534286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4abead0b4e4ad9ab6e0bb267e5115e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:47.535440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4abead0b4e4ad9ab6e0bb267e5115e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:47.536835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4abead0b4e4ad9ab6e0bb267e5115e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:47.551739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4abead0b4e4ad9ab6e0bb267e5115e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:47.591298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ab1f30-d825-45e9-b36d-42c957096d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4abead0b4e4ad9ab6e0bb267e5115e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:47.744407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1152/2312] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:51:47 2022] DELETE /identity/v3/users/5f4abead0b4e4ad9ab6e0bb267e5115e => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:48.140963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:48.143945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:48.189019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec34d41-dbb5-47ba-b945-b2e7699b359d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:48.297297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:48.298921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:48.300198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:48.301208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] PATH_INFO: `/v3/projects/104abca264bd460da610c527a5ff6b15` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:48.304279 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104abca264bd460da610c527a5ff6b15)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:48.309307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:48.474742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:48.483868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104abca264bd460da610c527a5ff6b15', 'request_id': 'req-a6eac76c-596c-49c2-a92b-26869faf3563'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:48.491174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104abca264bd460da610c527a5ff6b15', 'request_id': 'req-a6eac76c-596c-49c2-a92b-26869faf3563'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:48.501740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104abca264bd460da610c527a5ff6b15', 'request_id': 'req-a6eac76c-596c-49c2-a92b-26869faf3563'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:48.604068 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] The token cache is being invalidate because project 104abca264bd460da610c527a5ff6b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:51:48.604590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:48.605767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6eac76c-596c-49c2-a92b-26869faf3563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:48.617236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1161/2313] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:51:48 2022] DELETE /identity/v3/projects/104abca264bd460da610c527a5ff6b15 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:48.618589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:48.619441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:48.620668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:48.644250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:48.645563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:48.784963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1153/2314] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:51:48.803339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:48.804472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:48.805191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:48.832874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:48.834291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:48.844509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1162/2315] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:48.850941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:48.885205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecf948-e620-4484-9a74-35aef9b733cc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:48.900181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:48.901366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:48.902332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:48.902824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:48.904781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:51:48.905420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:48.910687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:48.945739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1154/2316] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:51:48.949879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:48.988474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56761c5-9cfc-4736-a09f-5b89d73d9dc6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:49.006286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:49.007482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.017449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.017449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.017449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:49.017449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:49.189887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1163/2317] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:51:48 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:49.199937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:49.218575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35cf9-c9e3-4692-b92b-182873ed36f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:49.343810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:49.344508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.344856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.345142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.346058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:49.348725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:49.367420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:49.449311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1155/2318] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:51:49 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:49.453747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:49.469188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9f988-cd76-4bd3-9742-0b868f0f4b71 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:49.476508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:49.477745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.478357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.478839 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.480537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:49.483704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:49.502395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1164/2319] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:51:49.507897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:49.533128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df40a-7a61-4fe9-ad15-c1e3304ea6e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:49.543707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:49.544922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.545536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.545756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.546697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:49.549124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a98f01-0503-4123-b2e6-e8e591f9e9d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:49.575316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1156/2320] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:51:49.576675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:49.588960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4079a-596a-44ac-a0c0-ea2df555abc4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:49.599984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:49.600773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.601258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.601552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] PATH_INFO: `/v3/projects/7d61b52a77ab4552ae36e8e3ba63e397/users/62cf1ba7294c4b13a7f7c526a30c36b9/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.644876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d61b52a77ab4552ae36e8e3ba63e397, user_id=62cf1ba7294c4b13a7f7c526a30c36b9, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:49.647769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:49.792099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1165/2321] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:51:49 2022] PUT /identity/v3/projects/7d61b52a77ab4552ae36e8e3ba63e397/users/62cf1ba7294c4b13a7f7c526a30c36b9/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:49.817314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bb84-ac98-4fc9-8c7b-2a19de43db07 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:49.819566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bb84-ac98-4fc9-8c7b-2a19de43db07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:49.820588 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bb84-ac98-4fc9-8c7b-2a19de43db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:49.893744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f8c4bb84-ac98-4fc9-8c7b-2a19de43db07 None None] MFA Rules not processed for user `62cf1ba7294c4b13a7f7c526a30c36b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:49.896129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f8c4bb84-ac98-4fc9-8c7b-2a19de43db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:50.089917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1157/2322] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:50.097850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:50.099736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:50.207206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545adf-7c69-40d5-83ae-d4e5061b61b6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:50.215423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:50.216544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:50.217069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:50.217572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:50.229394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:50.232213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:50.271892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1166/2323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:51:50.551330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e3aa-7581-473b-a3b3-a68feb74c54c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:50.551675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e3aa-7581-473b-a3b3-a68feb74c54c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:50.552099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e3aa-7581-473b-a3b3-a68feb74c54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:50.626619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5295e3aa-7581-473b-a3b3-a68feb74c54c None None] MFA Rules not processed for user `447a046eb95140f6a84a6692c7c96e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:50.627986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5295e3aa-7581-473b-a3b3-a68feb74c54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:50.731261 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1158/2324] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:50.757003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:50.758567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:50.780391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf75ba-1229-40ab-89c4-e1856ca8a155 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:50.786783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:50.787488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:50.787770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:50.788149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:50.790280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:50.872892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:50.887726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:50.889415 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:50.900079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1167/2325] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:51:54.780252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254febc-17b6-45ca-b148-d43319214382 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:54.780815 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254febc-17b6-45ca-b148-d43319214382 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:54.783708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254febc-17b6-45ca-b148-d43319214382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:54.821407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3254febc-17b6-45ca-b148-d43319214382 None None] MFA Rules not processed for user `6d56c325b6d94560bde44328c6690b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:54.824429 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3254febc-17b6-45ca-b148-d43319214382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:54.844710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1159/2326] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:57.446100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:57.525764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa451-b1ad-4eee-b278-f4644d34c9a3 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:57.530954 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:57.531656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:57.531938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:57.532214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] PATH_INFO: `/v3/users/62cf1ba7294c4b13a7f7c526a30c36b9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:57.533512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cf1ba7294c4b13a7f7c526a30c36b9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:57.535622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:57.781874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cf1ba7294c4b13a7f7c526a30c36b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:57.782817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cf1ba7294c4b13a7f7c526a30c36b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:57.783576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cf1ba7294c4b13a7f7c526a30c36b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:57.795734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cf1ba7294c4b13a7f7c526a30c36b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:57.860066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cf1ba7294c4b13a7f7c526a30c36b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:57.880624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1168/2327] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:51:57 2022] DELETE /identity/v3/users/62cf1ba7294c4b13a7f7c526a30c36b9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:51:57.886580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:57.887274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:57.887367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:57.910703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:57.914605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:57.978978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:57.994532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1160/2328] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:58.009605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:58.013118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:58.116802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d2d2-2c5c-46fe-803f-2119a9e2ab04 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:58.121827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:58.122509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:58.122884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:58.123246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:58.134266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:58.137093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06bb7f-4ed1-4b55-99e5-499a33e26dcf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:58.148007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1169/2329] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:51:58.978916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:58.981980 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:59.009937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d083d5b-0040-4223-9dab-1ad17f365c97 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.019197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.020005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.020397 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.020836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] PATH_INFO: `/v3/projects/7d61b52a77ab4552ae36e8e3ba63e397` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.022416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d61b52a77ab4552ae36e8e3ba63e397)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.031865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.179728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d61b52a77ab4552ae36e8e3ba63e397', 'request_id': 'req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:59.192008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d61b52a77ab4552ae36e8e3ba63e397', 'request_id': 'req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:59.272087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d61b52a77ab4552ae36e8e3ba63e397', 'request_id': 'req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:59.287204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] The token cache is being invalidate because project 7d61b52a77ab4552ae36e8e3ba63e397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:51:59.287543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:59.288193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c648bf8c-8e96-4ba0-b6d3-7e4f2d6d654d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:51:59.290367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1161/2330] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:51:58 2022] DELETE /identity/v3/projects/7d61b52a77ab4552ae36e8e3ba63e397 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:51:59.295908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.296532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.296532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.321021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:59.322280 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:59.329357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:59.395546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1170/2331] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:59.405688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.405970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.406248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.430043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:51:59.431470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:51:59.441328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1162/2332] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:51:59.448674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.462959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271af3e2-2457-4ee1-9ee6-b33ea25228b4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.471804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.472701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.473013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.473480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.474332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:51:59.474805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.477250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.497486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1171/2333] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:51:59.502315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.515005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a380c8-ee79-4742-9977-7492348ab2b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.522278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.523255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.523546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.523867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.524923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.529216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.661411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1163/2334] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:51:59 2022] POST /identity/v3/projects => generated 355 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:59.663799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.684679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e331-9e1b-4578-9218-4bb6f5075d79 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.795479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.796014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.796299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.796572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.797202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.799254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.890191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1172/2335] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:51:59 2022] POST /identity/v3/users => generated 278 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:51:59.894979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.907668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36369ef-88fa-436f-8ca2-9916ac91abf4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.915609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.917785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.917785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.917785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.917785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.919302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.931305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1164/2336] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:51:59.936343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.948615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d67d-0c1c-4770-935e-2d350859ea73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.953984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.958122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.958122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.958122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:51:59.958122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:51:59.958122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063c60-92ee-4602-8424-ad6a2573b3e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:51:59.970457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1173/2337] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:51:59.976201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:51:59.987273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac487-6bb7-43c2-a7d2-18581c1d58da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:51:59.992768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:51:59.993487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:51:59.993768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:51:59.994042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] PATH_INFO: `/v3/projects/b686d64e7dd0457b9c247f8c7a2d0a4e/users/0416a20213fd4abd932ef84ff6b401ff/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.012088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b686d64e7dd0457b9c247f8c7a2d0a4e, user_id=0416a20213fd4abd932ef84ff6b401ff, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:00.014839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:00.100838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1165/2338] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:51:59 2022] PUT /identity/v3/projects/b686d64e7dd0457b9c247f8c7a2d0a4e/users/0416a20213fd4abd932ef84ff6b401ff/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:00.112289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:00.112552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:00.112836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.146681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] MFA Rules not processed for user `0416a20213fd4abd932ef84ff6b401ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:00.148015 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:00.259543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1174/2339] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:00.265726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:00.378127 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097b9c-b722-4779-94e6-e981ae56e599 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:00.386353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:00.387441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:00.387921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:00.388392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.389535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:00.393234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:00.422629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:00.525757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1166/2340] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:00 2022] POST /identity/v3/projects => generated 357 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:52:00.532127 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:00.548094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a5f-2676-496e-a800-e2ab018ea828 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:00.553343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:00.624084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:00.624534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:00.624802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:00.625073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.625734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:00.627848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:00.724996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1175/2341] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:00 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:00.729769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:00.742727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a738877-46fe-4a59-b4ab-d92cf989b669 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:00.748947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:00.749804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:00.750048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:00.750329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.751008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:00.753244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:00.777987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1167/2342] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:00.782178 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:00.795861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d13e04-f033-4d9e-a62c-ef89593d929d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:00.801915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:00.802863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:00.803317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:00.803818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] PATH_INFO: `/v3/projects/a5b56f78fe8744029754278636ff4fa1/users/26d16852a0b145b48e042e6f557c3804/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:00.824593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b56f78fe8744029754278636ff4fa1, user_id=26d16852a0b145b48e042e6f557c3804, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:00.827463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:00.895402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1176/2343] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:00 2022] PUT /identity/v3/projects/a5b56f78fe8744029754278636ff4fa1/users/26d16852a0b145b48e042e6f557c3804/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:52:00.899592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:00.913335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc79f1b-31a8-4dec-a624-49b0acaf6668 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:00.999373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:01.000363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:01.000715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:01.001139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:01.002177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:01.004528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e35c-ae38-4496-a175-e985ecd9f591 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:01.017599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1168/2344] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:01.022508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:01.037270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192012b-f292-4fd9-abc0-160edab08566 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:01.044854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:01.045573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:01.045857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:01.046131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] PATH_INFO: `/v3/projects/a5b56f78fe8744029754278636ff4fa1/users/26d16852a0b145b48e042e6f557c3804/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:01.048257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b56f78fe8744029754278636ff4fa1, user_id=26d16852a0b145b48e042e6f557c3804, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:01.051123 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:01.065149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1177/2345] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:01 2022] PUT /identity/v3/projects/a5b56f78fe8744029754278636ff4fa1/users/26d16852a0b145b48e042e6f557c3804/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:01.076554 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:01.077051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:01.077506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:01.127809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] MFA Rules not processed for user `26d16852a0b145b48e042e6f557c3804`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:01.129295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:01.209254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1169/2346] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:01.223177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:01.225315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:01.297421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7dff-499b-4cc6-aea4-74a011e6eb4b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:01.301264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:01.301898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:01.302179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:01.302447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:01.313198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:01.314834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:01.327360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1178/2347] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:01.553421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:01.565432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2fec-47dd-4850-b8f5-b345955e41be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:01.571603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:01.572254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:01.572534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:01.573538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:01.644534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:01.645992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4704-7a7f-4e49-b4bb-4f0d74d07d46 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:01.657036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1170/2348] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:11.322045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:11.651723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:23.293977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:23.365765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282ce1-ec63-455b-b2d6-943d69ff5793 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:23.372391 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:23.373111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:23.373408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:23.373685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] PATH_INFO: `/v3/users/0416a20213fd4abd932ef84ff6b401ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:23.374984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0416a20213fd4abd932ef84ff6b401ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:23.377686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:23.605578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0416a20213fd4abd932ef84ff6b401ff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:23.606389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0416a20213fd4abd932ef84ff6b401ff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:23.606892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0416a20213fd4abd932ef84ff6b401ff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:23.613991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0416a20213fd4abd932ef84ff6b401ff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:23.711306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0416a20213fd4abd932ef84ff6b401ff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:23.732466 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1179/2349] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:23 2022] DELETE /identity/v3/users/0416a20213fd4abd932ef84ff6b401ff => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:23.737125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6143-285e-430e-b06d-e60a2573475f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:23.737701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6143-285e-430e-b06d-e60a2573475f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:23.737701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6143-285e-430e-b06d-e60a2573475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:23.760266 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-367b6143-285e-430e-b06d-e60a2573475f None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:23.761640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-367b6143-285e-430e-b06d-e60a2573475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:23.828839 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1171/2350] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:52:23.839940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:23.842003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:23.948131 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddb4c0-f6c7-43dc-9779-172d01cc1733 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:23.957947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:23.958582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:23.958861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:23.959166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:23.973503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:23.975530 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:23.987915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1180/2351] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:24.507346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b6143-285e-430e-b06d-e60a2573475f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:24.508794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-367b6143-285e-430e-b06d-e60a2573475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:24.524008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b6143-285e-430e-b06d-e60a2573475f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:24.530734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:24.531414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:24.531691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:24.531961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] PATH_INFO: `/v3/projects/b686d64e7dd0457b9c247f8c7a2d0a4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:24.533358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b686d64e7dd0457b9c247f8c7a2d0a4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:24.535307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:24.655439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b686d64e7dd0457b9c247f8c7a2d0a4e', 'request_id': 'req-a9cae089-fa5c-4368-9914-54948ba92de1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:24.661340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b686d64e7dd0457b9c247f8c7a2d0a4e', 'request_id': 'req-a9cae089-fa5c-4368-9914-54948ba92de1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:24.733514 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b686d64e7dd0457b9c247f8c7a2d0a4e', 'request_id': 'req-a9cae089-fa5c-4368-9914-54948ba92de1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:24.745749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] The token cache is being invalidate because project b686d64e7dd0457b9c247f8c7a2d0a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:24.746537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:24.746711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:24.748235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1172/2352] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:24 2022] DELETE /identity/v3/projects/b686d64e7dd0457b9c247f8c7a2d0a4e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:24.752567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:24.762449 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb410-ebda-4a4d-8e8f-9c07143be794 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:24.781909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:24.857714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:24.858356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:24.858638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:24.858911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] PATH_INFO: `/v3/users/26d16852a0b145b48e042e6f557c3804` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:24.860103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d16852a0b145b48e042e6f557c3804)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:24.862076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:25.304999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d16852a0b145b48e042e6f557c3804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:25.305750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d16852a0b145b48e042e6f557c3804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:25.307029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d16852a0b145b48e042e6f557c3804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:25.320427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d16852a0b145b48e042e6f557c3804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:25.487205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53668a8f-9516-482b-adc6-f275509a229d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d16852a0b145b48e042e6f557c3804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:25.514498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1181/2353] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:24 2022] DELETE /identity/v3/users/26d16852a0b145b48e042e6f557c3804 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:26.221708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:26.223188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:26.236668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cae089-fa5c-4368-9914-54948ba92de1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:26.303300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:26.303937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.304214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.304488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] PATH_INFO: `/v3/projects/a5b56f78fe8744029754278636ff4fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.305633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b56f78fe8744029754278636ff4fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:26.307932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:26.391595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:26.410382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b56f78fe8744029754278636ff4fa1', 'request_id': 'req-63246556-9308-4c46-a113-331a97e1787a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:26.417520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b56f78fe8744029754278636ff4fa1', 'request_id': 'req-63246556-9308-4c46-a113-331a97e1787a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:26.504857 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b56f78fe8744029754278636ff4fa1', 'request_id': 'req-63246556-9308-4c46-a113-331a97e1787a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:26.522614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] The token cache is being invalidate because project a5b56f78fe8744029754278636ff4fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:26.522828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:26.523563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-63246556-9308-4c46-a113-331a97e1787a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:26.525169 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1173/2354] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:26 2022] DELETE /identity/v3/projects/a5b56f78fe8744029754278636ff4fa1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:26.531105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.533499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.533499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.556561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:26.557824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:26.621370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1182/2355] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:26.630483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.630824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.631111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.653041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:26.654549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:26.662664 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1174/2356] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:26.668266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:26.681989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f802f-5e66-4222-93d1-0cdd935b0d1b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:26.686915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:26.687567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.687846 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.688119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.688776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:52:26.689086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:26.690689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:26.705000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1183/2357] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:52:26.711219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:26.723230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b9bd2-84b2-4734-831d-4d86fc4eb1db None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:26.729215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:26.729922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.730198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.730496 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.732276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:26.733413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:26.839124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1175/2358] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:26 2022] POST /identity/v3/projects => generated 401 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:52:26.843627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:26.855405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ced6c-1bb8-424b-a105-d8e1fb7779b1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:26.899693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:26.942334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:26.943067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:26.943424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:26.943622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:26.944291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:26.946254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.089657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1184/2359] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:26 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:52:27.093967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.105647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03e70-ba2d-4293-bc4e-7485e47533b6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.110350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.110950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.111257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.111527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.112174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.113768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.125900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1176/2360] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:27.130498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.141503 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebeb3-cac5-460d-8ac3-394c2aef3454 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.146576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.147299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.147585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.147859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.148513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.150180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65a80-896f-41c1-bfa8-f664e22228f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.163704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1185/2361] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:27.169506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.180945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85064ad-e4f6-41e2-ac1c-19e8037fd1dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.186498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.187209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.187492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.187768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] PATH_INFO: `/v3/projects/d2f8e2332d9c4f2b904e662cad300f2a/users/49911b7f68ab4bd2b1dd9758e208cd29/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.204655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8e2332d9c4f2b904e662cad300f2a, user_id=49911b7f68ab4bd2b1dd9758e208cd29, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.207417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.277234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1177/2362] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:27 2022] PUT /identity/v3/projects/d2f8e2332d9c4f2b904e662cad300f2a/users/49911b7f68ab4bd2b1dd9758e208cd29/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:27.287539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.287827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.288105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.318644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] MFA Rules not processed for user `49911b7f68ab4bd2b1dd9758e208cd29`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:27.319898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:27.385683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1186/2363] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:27.390102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.453750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3554ea-4154-4a8f-90db-abbb5fe851e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.458693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.459340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.459618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.459893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.460517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.462449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.560098 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1178/2364] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:27 2022] POST /identity/v3/projects => generated 399 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:27.564766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.594836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7e6f3-7868-4619-9196-358ec2d4b28f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.663989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.665229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.668508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.668508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.668508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.670302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.787537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1187/2365] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:27 2022] POST /identity/v3/users => generated 306 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:27.789819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.801873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf952d-4a6e-4015-be43-71d267072545 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.808067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.809051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.809459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.810187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.811216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.813988 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.826732 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1179/2366] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:27.831168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.843297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7145-bd8b-4c08-896e-5bca6e9afe11 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:27.848475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:27.849156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:27.849439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:27.849718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] PATH_INFO: `/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf/users/44cce6560beb4c86a9950aeae5fc2dcc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:27.867819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0cf9c06bb0458c9a43607aedea5aaf, user_id=44cce6560beb4c86a9950aeae5fc2dcc, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:27.870667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:27.961538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1188/2367] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:27 2022] PUT /identity/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf/users/44cce6560beb4c86a9950aeae5fc2dcc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:27.966661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:27.979372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130340-ae8d-4d62-a314-2caa38189905 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:28.002470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:28.058642 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:28.059349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:28.059633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:28.059913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:28.061869 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:28.062246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df1a28-9b30-45c4-a801-f470d8506674 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:28.073636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1180/2368] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:52:28.077872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:28.084781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:28.091381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa486d4-c911-4a23-9106-c89672bbf473 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:28.096318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:28.097004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:28.097339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:28.097532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] PATH_INFO: `/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf/users/44cce6560beb4c86a9950aeae5fc2dcc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:28.099514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0cf9c06bb0458c9a43607aedea5aaf, user_id=44cce6560beb4c86a9950aeae5fc2dcc, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:28.104795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:28.113206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1189/2369] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:28 2022] PUT /identity/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf/users/44cce6560beb4c86a9950aeae5fc2dcc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:28.125025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:28.125312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:28.125589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:28.153265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] MFA Rules not processed for user `44cce6560beb4c86a9950aeae5fc2dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:28.154487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:28.231479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1181/2370] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:28.242144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:28.243901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:28.304037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53635-cd09-4ffc-9631-d828c76c12a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:28.310360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:28.310977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:28.311291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:28.311562 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:28.321315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:28.323939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:28.334322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1190/2371] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:28.572829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:28.583571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef115-d00b-4e86-9d5c-b659cc5c5078 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:28.587392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:28.588336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:28.588641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:28.588968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:28.651205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:28.652696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:28.662135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1182/2372] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:32.750658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:32.752194 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:32.813918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d112-b0fd-40e8-b525-07d2bc12274e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:32.817602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:32.818206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:32.818509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:32.818779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:32.820610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:32.888915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:32.890367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86808d9-fa4a-4d44-8534-e1268443eaa5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:32.900928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1191/2373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:52:34.320216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:34.391608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:34.464257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a541f-8f63-4566-b17c-06435a336c65 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:34.469585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:34.470380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:34.470725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:34.471042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] PATH_INFO: `/v3/users/49911b7f68ab4bd2b1dd9758e208cd29` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:34.472402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49911b7f68ab4bd2b1dd9758e208cd29)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:34.474613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:34.744412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49911b7f68ab4bd2b1dd9758e208cd29'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:34.744822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49911b7f68ab4bd2b1dd9758e208cd29'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:34.745551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49911b7f68ab4bd2b1dd9758e208cd29'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:34.754319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49911b7f68ab4bd2b1dd9758e208cd29'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:34.771610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49911b7f68ab4bd2b1dd9758e208cd29'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:34.902861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1183/2374] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:34 2022] DELETE /identity/v3/users/49911b7f68ab4bd2b1dd9758e208cd29 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:34.908153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:34.908153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:34.908153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:34.973036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:34.974467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:34.985755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:35.062419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1192/2375] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:35.074373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:35.077009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:35.179455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0ba5-bc1d-41c6-9f96-2d21020ff51e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:35.184470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:35.185033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:35.185374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:35.185564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:35.197450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:35.199471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:35.211569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1184/2376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:35.785411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:35.787054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:35.813684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ac39-6397-4927-adb3-1862ff5a7315 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:35.829719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:35.829719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:35.829719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:35.829719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] PATH_INFO: `/v3/projects/d2f8e2332d9c4f2b904e662cad300f2a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:35.831134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f8e2332d9c4f2b904e662cad300f2a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:35.835361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:35.980255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f8e2332d9c4f2b904e662cad300f2a', 'request_id': 'req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:35.988728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f8e2332d9c4f2b904e662cad300f2a', 'request_id': 'req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:35.996414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f8e2332d9c4f2b904e662cad300f2a', 'request_id': 'req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.134574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] The token cache is being invalidate because project d2f8e2332d9c4f2b904e662cad300f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:36.135040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.135918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.137605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1193/2377] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:35 2022] DELETE /identity/v3/projects/d2f8e2332d9c4f2b904e662cad300f2a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:36.141956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:36.154846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b747-e1f4-4758-b075-7bd7e68eea87 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:36.161495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:36.250946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:36.252332 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:36.252683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:36.253071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] PATH_INFO: `/v3/users/44cce6560beb4c86a9950aeae5fc2dcc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:36.255578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cce6560beb4c86a9950aeae5fc2dcc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:36.258410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:36.515042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cce6560beb4c86a9950aeae5fc2dcc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.516160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cce6560beb4c86a9950aeae5fc2dcc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.517001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cce6560beb4c86a9950aeae5fc2dcc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.524829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cce6560beb4c86a9950aeae5fc2dcc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.551847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-858bef38-3393-4ea0-b10d-4a60760a1e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cce6560beb4c86a9950aeae5fc2dcc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:36.648841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1185/2378] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:36 2022] DELETE /identity/v3/users/44cce6560beb4c86a9950aeae5fc2dcc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:37.342243 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:37.343745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:37.368312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5a6b-56aa-4a3d-a87b-1c040eb1975f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:37.471393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:37.472058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:37.472340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:37.472615 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] PATH_INFO: `/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:37.473789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0cf9c06bb0458c9a43607aedea5aaf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:37.475951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:37.591514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:37.598788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0cf9c06bb0458c9a43607aedea5aaf', 'request_id': 'req-fddb265e-9e7f-424a-b0c4-cbfdd868d427'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:37.606904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0cf9c06bb0458c9a43607aedea5aaf', 'request_id': 'req-fddb265e-9e7f-424a-b0c4-cbfdd868d427'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:37.614215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0cf9c06bb0458c9a43607aedea5aaf', 'request_id': 'req-fddb265e-9e7f-424a-b0c4-cbfdd868d427'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:37.705778 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] The token cache is being invalidate because project 2c0cf9c06bb0458c9a43607aedea5aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:37.706081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:37.706776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fddb265e-9e7f-424a-b0c4-cbfdd868d427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:37.708348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1194/2379] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:37 2022] DELETE /identity/v3/projects/2c0cf9c06bb0458c9a43607aedea5aaf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:37.714155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:37.714710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:37.714710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:37.789551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:37.791762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:37.861803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1186/2380] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:37.870520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:37.870820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:37.871206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:37.892408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:37.894470 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:37.903762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1195/2381] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:37.908310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:37.914871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:37.926677 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292d9b-573f-4d50-92d3-f597bdab91be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:37.932305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:37.932970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:37.933259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:37.938893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:37.938893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:52:37.938893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:37.938893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:37.951371 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1187/2382] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:52:37.960613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:37.973383 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd501f6-cfc9-48a3-92a8-c4c674a278ef None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:37.987906 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:37.988536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:37.988890 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:37.989164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:37.989780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:37.991775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.147379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1196/2383] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:37 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:38.152155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.162669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15dda-7f4a-4c4e-b42d-39f15b69d3de admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:38.233559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:38.234186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.234471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.234877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.235555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:38.238181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.342751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1188/2384] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:38 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:38.348108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.360359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc667-14d1-4d19-a839-717702d63bfe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:38.365245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:38.365871 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.366268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.366478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.367161 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:38.368817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.379981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1197/2385] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:52:38.384864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.396643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45974-0608-4ebc-8431-c95f647a675f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:38.402519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:38.405534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.405534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.405534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.405534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:38.406751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2391720-0d37-468c-a8c2-19b2d1a93da0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.421873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1189/2386] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:38.423841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.441283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae0a4-5e46-485e-a358-d6a0ad568dd6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:38.450288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:38.451663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.452387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.452981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] PATH_INFO: `/v3/projects/8da6e520813746a5adde989bb9d1a68a/users/bf25032061104289a311c38943fa7422/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.485037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da6e520813746a5adde989bb9d1a68a, user_id=bf25032061104289a311c38943fa7422, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:38.492619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.575232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1198/2387] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:38 2022] PUT /identity/v3/projects/8da6e520813746a5adde989bb9d1a68a/users/bf25032061104289a311c38943fa7422/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:38.587058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.587692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.588180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.625590 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] MFA Rules not processed for user `bf25032061104289a311c38943fa7422`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:38.626827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:38.710498 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1190/2388] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:38.715799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.787045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626191d-27c0-4b63-9cc1-4af48cfb0cf0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:38.793197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:38.793989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:38.794174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:38.794389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:38.795033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:38.797004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:38.891046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1199/2389] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:38 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:38.895130 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:38.906448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40322fba-c204-4404-92c4-d63c42793a70 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.011234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.011948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.012280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.012553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.013207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.015856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.024074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:39.169314 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1191/2390] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:38 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:39.174842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:39.185579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736c73-d075-4145-acf1-505994b0177d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.190563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.191240 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.191661 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.191943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.192595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.194339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.206916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1200/2391] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:39.211160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:39.222852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cacf-bf53-44d6-9d6e-45277d86b7f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.228971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.229635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.230216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.230216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] PATH_INFO: `/v3/projects/c66bbe190ef54978adc545e090f5c831/users/9a8e3b32c9b94cbb8a28b77a0f66d2df/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.247002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66bbe190ef54978adc545e090f5c831, user_id=9a8e3b32c9b94cbb8a28b77a0f66d2df, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.249768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.410152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1192/2392] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:39 2022] PUT /identity/v3/projects/c66bbe190ef54978adc545e090f5c831/users/9a8e3b32c9b94cbb8a28b77a0f66d2df/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:39.415180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:39.426632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92be9a9-fa2d-4883-ae59-49f0e8a4ea7b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.489863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:39.516284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.516978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.517302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.517701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.518676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.522220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99cdf6-1fd4-4407-8b8a-e326919f37e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.538864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1201/2393] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:52:39.545026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:39.561383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791256-c4b9-4bef-9772-52d57cf3e275 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.572450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.574409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.574566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.575011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] PATH_INFO: `/v3/projects/c66bbe190ef54978adc545e090f5c831/users/9a8e3b32c9b94cbb8a28b77a0f66d2df/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.578457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66bbe190ef54978adc545e090f5c831, user_id=9a8e3b32c9b94cbb8a28b77a0f66d2df, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.588493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.603230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1193/2394] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:39 2022] PUT /identity/v3/projects/c66bbe190ef54978adc545e090f5c831/users/9a8e3b32c9b94cbb8a28b77a0f66d2df/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:52:39.622070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a2a29-462c-48b6-b717-190010eb419a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.622429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a2a29-462c-48b6-b717-190010eb419a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.622812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a2a29-462c-48b6-b717-190010eb419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.664721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-561a2a29-462c-48b6-b717-190010eb419a None None] MFA Rules not processed for user `9a8e3b32c9b94cbb8a28b77a0f66d2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:39.666294 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-561a2a29-462c-48b6-b717-190010eb419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:39.771539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1202/2395] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:39.796707 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:39.799663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:39.873865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0d588-fffd-4621-b574-de8664909101 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:39.877596 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:39.878207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:39.878492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:39.878762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:39.890358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:39.893345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd658-9d84-4ea4-9a60-4cd56d53b4c1 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:39.910762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1194/2396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:40.583915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a2a29-462c-48b6-b717-190010eb419a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:40.654901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a2a29-462c-48b6-b717-190010eb419a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:40.659821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:40.660461 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:40.660744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:40.661018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] PATH_INFO: `/v3/users/bf25032061104289a311c38943fa7422` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:40.662228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25032061104289a311c38943fa7422)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:40.664482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:40.892366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25032061104289a311c38943fa7422'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:40.893380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25032061104289a311c38943fa7422'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:40.894319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25032061104289a311c38943fa7422'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:40.907926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25032061104289a311c38943fa7422'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:41.047887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25032061104289a311c38943fa7422'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:41.049809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:41.073720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1203/2397] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:40 2022] DELETE /identity/v3/users/bf25032061104289a311c38943fa7422 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:41.080217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:41.081054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:41.081054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:41.100581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:41.101808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:41.166940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1195/2398] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:41.179116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:41.180561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:41.246680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289afb-9b3f-423e-acb2-b3428c45a6a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:41.250318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:41.250931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:41.251245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:41.251513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:41.261859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:41.263340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:41.273018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1204/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:41.845540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:41.845540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:41.863530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44480ef6-9232-4d47-8191-b1314701eb50 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:41.870571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:41.871125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:41.871419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:41.871701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] PATH_INFO: `/v3/projects/8da6e520813746a5adde989bb9d1a68a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:41.873225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da6e520813746a5adde989bb9d1a68a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:41.875280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:42.026837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da6e520813746a5adde989bb9d1a68a', 'request_id': 'req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.028114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:42.034441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da6e520813746a5adde989bb9d1a68a', 'request_id': 'req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.116703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da6e520813746a5adde989bb9d1a68a', 'request_id': 'req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.131285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] The token cache is being invalidate because project 8da6e520813746a5adde989bb9d1a68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:42.131582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.138771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f8dd2202-f5b3-4e44-8e49-043be9c5bb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.138771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1196/2400] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:41 2022] DELETE /identity/v3/projects/8da6e520813746a5adde989bb9d1a68a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:52:42.138983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:42.149305 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b273-f719-4dcf-8c1a-ddd5bfad5bf9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:42.251412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:42.252257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:42.252576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:42.252937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] PATH_INFO: `/v3/users/9a8e3b32c9b94cbb8a28b77a0f66d2df` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:42.254596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8e3b32c9b94cbb8a28b77a0f66d2df)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:42.256740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:42.445303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8e3b32c9b94cbb8a28b77a0f66d2df'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.446049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8e3b32c9b94cbb8a28b77a0f66d2df'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.446684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8e3b32c9b94cbb8a28b77a0f66d2df'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.457939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8e3b32c9b94cbb8a28b77a0f66d2df'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.539062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8e3b32c9b94cbb8a28b77a0f66d2df'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:42.567602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1205/2401] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:52:42 2022] DELETE /identity/v3/users/9a8e3b32c9b94cbb8a28b77a0f66d2df => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:42.746119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c88f5-b417-4180-82de-9147d51d6d51 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:42.746403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c88f5-b417-4180-82de-9147d51d6d51 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:42.746686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c88f5-b417-4180-82de-9147d51d6d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:42.765942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f38c88f5-b417-4180-82de-9147d51d6d51 None None] MFA Rules not processed for user `5153ddc5d5e4480a81e636fba58821d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:42.767287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f38c88f5-b417-4180-82de-9147d51d6d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:42.833229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1197/2402] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:43.210734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:43.214750 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:43.218250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:43.336411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68139b-a5df-4142-853e-cc7469c028ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:43.344002 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:43.344915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:43.345265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:43.345560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] PATH_INFO: `/v3/projects/c66bbe190ef54978adc545e090f5c831` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:43.346826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66bbe190ef54978adc545e090f5c831)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:43.349962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:43.516583 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66bbe190ef54978adc545e090f5c831', 'request_id': 'req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:43.527377 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66bbe190ef54978adc545e090f5c831', 'request_id': 'req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:43.545740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66bbe190ef54978adc545e090f5c831', 'request_id': 'req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:43.710353 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] The token cache is being invalidate because project c66bbe190ef54978adc545e090f5c831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:52:43.710764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:43.711694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fe4cf23-9851-41b0-91e0-ae9cef2e87ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:52:43.713248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1206/2403] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:52:43 2022] DELETE /identity/v3/projects/c66bbe190ef54978adc545e090f5c831 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:52:43.719129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:43.719598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:43.719870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:43.741993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:43.744129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:43.832224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1198/2404] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:43.841328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:43.841610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:43.841884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:43.870726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:43.872039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:43.881423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1207/2405] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:43.886718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:43.898660 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc72a0-ae64-4f27-ba43-60e8b310d786 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:43.904601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:43.905274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:43.905594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:43.905902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:43.906763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:52:43.907072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:43.908737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:43.924989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1199/2406] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:52:43.932235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:43.943271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee88a5-9a36-4f78-bb19-3dbffcbf2f92 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:43.951023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:43.958071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:43.958071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:43.958071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:43.958071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:43.958071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.102241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1208/2407] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:52:43 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:44.114613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:44.126099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff620c-e030-4481-af11-dd53610e3e5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:44.191006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:44.191651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.191931 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.192198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.192830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:44.194789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.283456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:44.288739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1200/2408] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:52:44 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:52:44.293821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:44.304537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2dd9-62cb-4925-ab78-746ae7e324be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:44.310032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:44.310646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.310922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.311226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.311868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:44.313455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.325639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1209/2409] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:44.329903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:44.341128 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc43e0-85ac-4389-90cc-6b4e4cca9e53 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:44.346468 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:44.347201 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.347479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.347750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.348430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:44.350142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703e034-0ab1-4803-b7a9-e343183df084 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.364161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1201/2410] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:52:44.369681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:44.381049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f89e2-c031-4f8a-b0b2-6a3507d76756 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:44.389060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:44.389060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.389060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.389060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] PATH_INFO: `/v3/projects/ac427325dcf44cdc8bdd1a3d182afc92/users/091a602548b64b8bb34ade1ed0c1852e/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.418625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac427325dcf44cdc8bdd1a3d182afc92, user_id=091a602548b64b8bb34ade1ed0c1852e, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:44.423363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.579034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1210/2411] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:52:44 2022] PUT /identity/v3/projects/ac427325dcf44cdc8bdd1a3d182afc92/users/091a602548b64b8bb34ade1ed0c1852e/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:52:44.591268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.591557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.591833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.629833 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] MFA Rules not processed for user `091a602548b64b8bb34ade1ed0c1852e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:44.631251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:44.727011 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1202/2412] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:52:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:52:44.742450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:44.745222 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:44.802511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:44.832297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21823c-501f-40a8-88b7-e387c5efff18 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:44.836626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:44.839067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:44.839067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:44.839067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:44.848224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:44.850087 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839e8d3-ea6e-4ed8-ae29-8632e2b2cdef service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:44.860432 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1211/2413] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:45.470658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:45.472110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:45.610966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2518f56-3527-490e-b5d0-a9e77a259e26 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:45.618078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:45.618729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:45.619005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:45.619304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:45.621197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:45.638224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:45.640307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:45.652569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1203/2414] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:52:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:52:55.230451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=13 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:55.647303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:59.090512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ff8-f01d-40b4-be99-bad5249cf4da None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:59.091040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ff8-f01d-40b4-be99-bad5249cf4da None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:59.091040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443ff8-f01d-40b4-be99-bad5249cf4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:59.121877 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d5443ff8-f01d-40b4-be99-bad5249cf4da None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:52:59.123124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5443ff8-f01d-40b4-be99-bad5249cf4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:59.185238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1212/2415] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:52:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:52:59.362025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:52:59.363527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:52:59.446644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ec97-afdf-4136-a25e-f3f293db30c4 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:52:59.457419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:52:59.457419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:52:59.457419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:52:59.457419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:52:59.466594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:52:59.468372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774723ed-6e6b-4282-aa55-945d0c82a9ec service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:52:59.486025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1204/2416] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:52:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:09.178134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=32 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:09.475786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:20.816916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b800f6-7476-483a-a81e-aa79bca1391e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:20.818303 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b800f6-7476-483a-a81e-aa79bca1391e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:20.818529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b800f6-7476-483a-a81e-aa79bca1391e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:20.820124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1213/2417] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:53:20.827612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ada68-c5ac-4c5d-9654-90d2d7758d08 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:20.828524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ada68-c5ac-4c5d-9654-90d2d7758d08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:20.829058 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ada68-c5ac-4c5d-9654-90d2d7758d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:20.875411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e02ada68-c5ac-4c5d-9654-90d2d7758d08 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:20.876955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e02ada68-c5ac-4c5d-9654-90d2d7758d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:20.992592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1205/2418] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:53:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:21.006769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b800f6-7476-483a-a81e-aa79bca1391e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:21.018747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b800f6-7476-483a-a81e-aa79bca1391e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:21.023251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e90e02cb2741c6bda1ecd01d92cf6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:21.023873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.024190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.024463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.042881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:21.044710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b9cc-e857-4258-96ef-900c13e117c0 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:21.059019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1214/2419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:53:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:53:21.396436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.396876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.397158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.399435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1206/2420] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:53:21.420940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa23ea-98bd-4986-8300-ff053a89c8cb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.421361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa23ea-98bd-4986-8300-ff053a89c8cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.421516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa23ea-98bd-4986-8300-ff053a89c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.461892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a9aa23ea-98bd-4986-8300-ff053a89c8cb None None] MFA Rules not processed for user `c9a500c664114c47a3f856b8eb2b326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:21.463687 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a9aa23ea-98bd-4986-8300-ff053a89c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:21.537577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1215/2421] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:53:21.551699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:21.553807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:21.568635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff0424-6ec8-4864-806e-ca1210acd72b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:21.580406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:21.580406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.580406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.580406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.584367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:21.585864 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744fd1b-71fc-469f-867a-09344f4df677 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:21.599116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1207/2422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:53:21.684949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc87a3-52d8-429f-b690-83d84b1b0acf None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.685394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc87a3-52d8-429f-b690-83d84b1b0acf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.685853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc87a3-52d8-429f-b690-83d84b1b0acf None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.687716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1216/2423] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 17:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:53:21.693553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.693863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.694077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.715725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] MFA Rules not processed for user `64a58fc0c9a3444a8e5c741204c4dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:21.716962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:21.727046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1208/2424] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:21.738464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc87a3-52d8-429f-b690-83d84b1b0acf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:21.750416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc87a3-52d8-429f-b690-83d84b1b0acf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:21.754177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:21.754798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:21.755074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:21.755446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:21.766180 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:21.767657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b258d1-6f6f-4ed3-a25a-585074a394a8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:21.779311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1217/2425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:53:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:53:22.493131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:22.569856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae84f7-8e15-4a3b-a3a4-51f8cc799bc1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:22.575452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:22.576114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:22.576422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:22.576696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] PATH_INFO: `/v3/users/091a602548b64b8bb34ade1ed0c1852e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:22.577885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091a602548b64b8bb34ade1ed0c1852e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:22.579933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:22.790244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091a602548b64b8bb34ade1ed0c1852e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:22.791582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091a602548b64b8bb34ade1ed0c1852e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:22.792168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091a602548b64b8bb34ade1ed0c1852e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:22.798355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:22.800933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091a602548b64b8bb34ade1ed0c1852e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:22.816280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091a602548b64b8bb34ade1ed0c1852e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:22.920339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1209/2426] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:53:22 2022] DELETE /identity/v3/users/091a602548b64b8bb34ade1ed0c1852e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:53:22.927043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:22.927043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:22.927043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:22.951007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:22.952706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:23.026991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1218/2427] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:23.038096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:23.040161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:23.124825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92570ba5-a3eb-4b6c-897b-72dbc2bb1399 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:23.130096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:23.130751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:23.131034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:23.139258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:23.151032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:23.153441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a3b44-7723-40e2-ae26-5ec5b70ad21f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:23.170747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1210/2428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:53:23.820135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:23.822405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:23.837988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40881b9-fc07-4248-a52b-5d289d4d3626 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:23.844698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:23.845447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:23.845736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:23.846795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] PATH_INFO: `/v3/projects/ac427325dcf44cdc8bdd1a3d182afc92` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:23.847539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac427325dcf44cdc8bdd1a3d182afc92)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:23.849639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:23.999985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac427325dcf44cdc8bdd1a3d182afc92', 'request_id': 'req-1aadf35a-f639-4eca-9246-2349c1440249'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:24.007255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac427325dcf44cdc8bdd1a3d182afc92', 'request_id': 'req-1aadf35a-f639-4eca-9246-2349c1440249'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:24.008509 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:24.025666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac427325dcf44cdc8bdd1a3d182afc92', 'request_id': 'req-1aadf35a-f639-4eca-9246-2349c1440249'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:24.178932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] The token cache is being invalidate because project ac427325dcf44cdc8bdd1a3d182afc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:53:24.179375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:24.180442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aadf35a-f639-4eca-9246-2349c1440249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:53:24.185037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1219/2429] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:53:23 2022] DELETE /identity/v3/projects/ac427325dcf44cdc8bdd1a3d182afc92 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:53:24.191827 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.192631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.192631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.226109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:24.229670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:24.308539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1211/2430] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:24.316843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.317129 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.317411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.339307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:24.340675 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:24.349308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1220/2431] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:24.354765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.366662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b831a1-a468-498d-9ff7-6c644e26396d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.374552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.375251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.375251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.375413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.376296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:53:24.376637 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.378263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32991f-fce0-4ebe-b7e0-0d959fd47110 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.398897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1212/2432] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:53:24.399775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.410688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b300a-8a3d-4a75-bafd-ae306c0d9dac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.416674 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.417423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.417706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.417984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.418612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.420563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.561527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.561959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.562296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.585295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1221/2433] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:53:24 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:53:24.590654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.605852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:24.607047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:24.679367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1213/2434] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:53:24.692892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.694523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:24.702939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852917-0407-4cb0-b117-f79d02797c9c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.705606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:24.710955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.714979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.714979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.714979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.715773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.719593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.803442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91cef-abda-42c1-ace9-41ea07ce3458 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.810399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.811217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.811613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.811989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.822614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.824282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.833684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1214/2435] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:53:24.850720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1222/2436] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:53:24 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:53:24.851890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.868064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736c95-a19e-4e42-8c64-fe82cfd97da3 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.875111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.875991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.876365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.876765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.877670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.880040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.892811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1215/2437] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:53:24.897160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.909124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2d7e-f5b9-430f-9fec-dba22c9516f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.916506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.917168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.917442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.917864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.918556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.920276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98902f-d3cf-41d7-8998-193e0d53d448 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:24.936834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1223/2438] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:53:24.941802 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:24.953101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a81a9-76d4-486e-8abd-d2e0f0278ddc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:24.958155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:24.959022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:24.959422 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:24.959708 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] PATH_INFO: `/v3/projects/a005f21d156d4df980c36cfb0e86a7d6/users/73b3290b6b45409f96d853e32a644d94/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:24.978760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a005f21d156d4df980c36cfb0e86a7d6, user_id=73b3290b6b45409f96d853e32a644d94, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:24.981890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:25.101747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1216/2439] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:53:24 2022] PUT /identity/v3/projects/a005f21d156d4df980c36cfb0e86a7d6/users/73b3290b6b45409f96d853e32a644d94/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:53:25.197217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd53d-90a7-4855-a263-f8b18ec25964 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:25.198230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd53d-90a7-4855-a263-f8b18ec25964 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:25.198230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd53d-90a7-4855-a263-f8b18ec25964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:25.263066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-670cd53d-90a7-4855-a263-f8b18ec25964 None None] MFA Rules not processed for user `73b3290b6b45409f96d853e32a644d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:25.267463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-670cd53d-90a7-4855-a263-f8b18ec25964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:25.396299 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1224/2440] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:53:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:53:25.414774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:25.417721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:25.561995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2782f-01f0-4bfd-8002-489bf9650536 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:25.574551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:25.575444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:25.575736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:25.576026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:25.600526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:25.604367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:25.627800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1217/2441] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:53:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:53:35.392315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:35.614995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:45.833117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:45.833587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:45.833680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:45.854026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] MFA Rules not processed for user `89ab0b719a1948b583a8202886902a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:53:45.855264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:53:45.916896 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1225/2442] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 17:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:53:45.930810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:53:46.000028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b67a-f823-440f-8f93-c1e8ceb1ecd0 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:53:46.006632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd90ca5a48c7411eaee2f3fda54d9dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:53:46.007489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:53:46.007916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:53:46.008308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:53:46.018671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:53:46.020365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:53:46.029190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1218/2443] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 17:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:53:55.909215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=25 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:56.025216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:05.281603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:05.283477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:05.356898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfe324-670e-474b-9879-8498f87fe0a2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:05.362040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:05.362667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:05.362943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:05.363254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:05.365067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:05.433936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:05.435752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:05.451500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1226/2444] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:09.253539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:09.255204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:09.336824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c98f06-3f0d-4c14-bc63-36fce01b5b71 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:09.343855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:09.353967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:09.353967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:09.353967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:09.353967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:09.361178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:09.362807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:09.373953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1219/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:09.451219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:09.451219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:09.465003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc972-7db8-4206-8c76-3474dd9c7fa2 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:09.470217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:09.470865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:09.471166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:09.471469 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] PATH_INFO: `/v3/users/924185a6e69b4e9aa8bcc456c096015e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:09.472623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924185a6e69b4e9aa8bcc456c096015e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:09.474577 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:09.858955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:09.870412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d091-f8f4-4796-980e-124b2c2638e5 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:09.877915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:09.878602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:09.878883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:09.879184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] PATH_INFO: `/v3/users/73b3290b6b45409f96d853e32a644d94` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:09.881007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b3290b6b45409f96d853e32a644d94)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:09.882341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:09.888411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924185a6e69b4e9aa8bcc456c096015e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:09.889120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924185a6e69b4e9aa8bcc456c096015e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:09.889753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924185a6e69b4e9aa8bcc456c096015e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:09.898500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924185a6e69b4e9aa8bcc456c096015e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:09.976443 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924185a6e69b4e9aa8bcc456c096015e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:09.996874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1227/2446] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:09 2022] DELETE /identity/v3/users/924185a6e69b4e9aa8bcc456c096015e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:10.138550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b3290b6b45409f96d853e32a644d94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.139186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b3290b6b45409f96d853e32a644d94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.139849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b3290b6b45409f96d853e32a644d94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.147676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b3290b6b45409f96d853e32a644d94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.161199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-397a6009-bc4b-4bad-a4ec-b7346a04f320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b3290b6b45409f96d853e32a644d94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.259506 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1220/2447] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:09 2022] DELETE /identity/v3/users/73b3290b6b45409f96d853e32a644d94 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:10.264144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:10.269536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.269536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.269853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:10.269957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.288421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:10.289663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:10.309172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:10.355175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143c4f-915e-41ad-8eac-8088e10a9659 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:10.358884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1221/2448] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:10.362334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:10.362334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.362334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.362334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] PATH_INFO: `/v3/projects/0dfcf993fd3c4344b486801feb222f63` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.362732 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfcf993fd3c4344b486801feb222f63)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:10.364492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:10.370180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:10.372268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:10.377943 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:10.430280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c5a1-214c-4f4c-af47-a8be91aab221 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:10.434473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:10.435075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.435427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.435706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.445277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:10.446735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d884-4d2d-4203-ad07-e9e89c53c5b5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:10.467199 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1222/2449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:10.478373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfcf993fd3c4344b486801feb222f63', 'request_id': 'req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.485086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfcf993fd3c4344b486801feb222f63', 'request_id': 'req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.492177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfcf993fd3c4344b486801feb222f63', 'request_id': 'req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.638908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] The token cache is being invalidate because project 0dfcf993fd3c4344b486801feb222f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:10.639254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.639811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52824d5b-2d6e-4b5b-a6d4-8d5822b559de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:10.641379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1228/2450] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:10 2022] DELETE /identity/v3/projects/0dfcf993fd3c4344b486801feb222f63 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:10.646414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.646701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.646979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.668684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:10.670417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:10.738883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1223/2451] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:10.752223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.753198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.753198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.906534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:10.907708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:10.916728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1229/2452] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:10.921376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:10.932082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605771-b85e-4363-8fec-1d3e101b499a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:10.938191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:10.942955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:10.956443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1224/2453] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:54:10.961074 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:10.971013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cf96b-936e-460d-947f-b081f00afaa1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:10.984887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:10.987140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:10.987140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:10.987140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:10.987140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:10.988484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.025937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.028003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:11.045153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630a4a-bcb1-4671-8a29-0288a8a4965f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.050032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.050811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.051141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.051420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] PATH_INFO: `/v3/projects/a005f21d156d4df980c36cfb0e86a7d6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.052570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a005f21d156d4df980c36cfb0e86a7d6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.054852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.128593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1230/2454] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:10 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:11.132987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.170965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a005f21d156d4df980c36cfb0e86a7d6', 'request_id': 'req-9914d099-ae43-49f9-b704-223ef0dcdb18'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:11.178551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a005f21d156d4df980c36cfb0e86a7d6', 'request_id': 'req-9914d099-ae43-49f9-b704-223ef0dcdb18'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:11.202335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d7ed0-e388-4679-b36d-01896aca5a59 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.231502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:11.250861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a005f21d156d4df980c36cfb0e86a7d6', 'request_id': 'req-9914d099-ae43-49f9-b704-223ef0dcdb18'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:11.261083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.261703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.261980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.262247 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.262866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.264820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.264970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] The token cache is being invalidate because project a005f21d156d4df980c36cfb0e86a7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:11.265401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:11.265812 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:11.267440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1225/2455] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:11 2022] DELETE /identity/v3/projects/a005f21d156d4df980c36cfb0e86a7d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:11.412316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1231/2456] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:11 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:54:11.416751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.418945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:11.432509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d099-ae43-49f9-b704-223ef0dcdb18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.438021 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.438657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.438939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.439248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.443401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.443401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.453489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1226/2457] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:54:11.457821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.468611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e59e-21c2-4bd0-8ebe-4fddc2f51ab8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.475312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.476065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.476348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.476622 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.477277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.478985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a5793-5b56-42f0-a24f-5cfc81a66f94 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.492330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1232/2458] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:11.497762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.504576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:11.509255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d0d0-fa3d-492a-ba73-83da52e81c24 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.514681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.516457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.516457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.516457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] PATH_INFO: `/v3/projects/53ca3231696046c48336167ec8941b09/users/b49e4799590241319f98c6cc4a039d85/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.532164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ca3231696046c48336167ec8941b09, user_id=b49e4799590241319f98c6cc4a039d85, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.534847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.641472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1227/2459] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:11 2022] PUT /identity/v3/projects/53ca3231696046c48336167ec8941b09/users/b49e4799590241319f98c6cc4a039d85/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:11.654246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.654601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.654913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.700659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] MFA Rules not processed for user `b49e4799590241319f98c6cc4a039d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:11.701799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:11.768249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1233/2460] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:11.773350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.841402 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7903f9-9724-4098-95a2-a1cb482c4eec admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:11.846202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:11.846807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:11.847101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:11.847396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:11.848059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:11.849970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:11.961503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1228/2461] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:11 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:11.966745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:11.978237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e443-3eda-4162-93c5-62c67bcaa7a5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.035740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.036351 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.036742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.036905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.037587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.039818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.121556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1234/2462] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:11 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:54:12.126217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.137078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde266c-f0ea-4372-8526-09a4aadc5c31 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.141767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.142355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.142628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.142899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.143695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.145275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.156111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1229/2463] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:12.160473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.172096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b33c-7fec-4d36-b08d-07607429e6dd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.177020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.177682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.177959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.178230 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] PATH_INFO: `/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2/users/17fef10209c64f4586af72ee0dab9749/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.194198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afee3e50aa24b46a82aaf1aaeb28aa2, user_id=17fef10209c64f4586af72ee0dab9749, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.196905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.264586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1235/2464] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:12 2022] PUT /identity/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2/users/17fef10209c64f4586af72ee0dab9749/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:12.269018 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.280012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496deef-a159-418e-9131-8d1aa29e3f6b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.338719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.340009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.340364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.340685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.341317 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.342955 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a467b-1020-4114-867d-47f580fdd6ac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.353346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1230/2465] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:12.358416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.365169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:12.369136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a223bb-38ee-4b9e-a9cd-98b4aa02f770 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.374412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.375071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.375382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.375655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] PATH_INFO: `/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2/users/17fef10209c64f4586af72ee0dab9749/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.377593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afee3e50aa24b46a82aaf1aaeb28aa2, user_id=17fef10209c64f4586af72ee0dab9749, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.380356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.390717 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1236/2466] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:12 2022] PUT /identity/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2/users/17fef10209c64f4586af72ee0dab9749/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:12.401008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.402363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.402363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.431689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] MFA Rules not processed for user `17fef10209c64f4586af72ee0dab9749`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:12.432992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:12.472595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:12.501255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1231/2467] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:12.512807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.514668 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:12.575373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804b71-29ee-4e36-acec-79cef825d310 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.579151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.579767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.580051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.580355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.590515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.592083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.602208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1237/2468] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:12.835963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:12.847922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f30f-943e-4e95-94c9-a6d40acc6da7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:12.851475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:12.852108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:12.852365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:12.852646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:12.916961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:12.918415 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f72975-f41d-4efd-9fb3-b5782a1d1214 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:12.928211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1232/2469] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:21.771024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:21.835052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c531-d9d4-4943-94e6-9e2ba6ee1b76 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:21.839563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:21.840216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:21.840480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:21.840764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] PATH_INFO: `/v3/users/b49e4799590241319f98c6cc4a039d85` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:21.841901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49e4799590241319f98c6cc4a039d85)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:21.844214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:22.073120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49e4799590241319f98c6cc4a039d85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.073787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49e4799590241319f98c6cc4a039d85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.074398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49e4799590241319f98c6cc4a039d85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.082277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49e4799590241319f98c6cc4a039d85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.167140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49e4799590241319f98c6cc4a039d85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.187188 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1238/2470] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:21 2022] DELETE /identity/v3/users/b49e4799590241319f98c6cc4a039d85 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:22.191983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:22.192538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:22.192538 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:22.213624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:22.214881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:22.277694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1233/2471] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:22.288401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:22.289821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:22.304815 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:22.349557 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0f90-c63c-4b23-90b9-48bf22458c7c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:22.353063 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:22.357447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:22.357447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:22.357447 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:22.364334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:22.365763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:22.375900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1239/2472] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:22.820654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:22.822470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:22.838192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ec712-6e2d-478c-b81b-8534ee76ca49 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:22.842871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:22.844178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:22.844649 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:22.844929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] PATH_INFO: `/v3/projects/53ca3231696046c48336167ec8941b09` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:22.846195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ca3231696046c48336167ec8941b09)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:22.851675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:22.955761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ca3231696046c48336167ec8941b09', 'request_id': 'req-755925cf-7389-4fbf-bed6-2f84d0011102'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:22.961993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ca3231696046c48336167ec8941b09', 'request_id': 'req-755925cf-7389-4fbf-bed6-2f84d0011102'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.087124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ca3231696046c48336167ec8941b09', 'request_id': 'req-755925cf-7389-4fbf-bed6-2f84d0011102'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.098582 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:23.104942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] The token cache is being invalidate because project 53ca3231696046c48336167ec8941b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:23.108512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.108512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.108512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1234/2473] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:22 2022] DELETE /identity/v3/projects/53ca3231696046c48336167ec8941b09 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:23.112618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:23.123671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e91a-094b-4e45-99c0-478376191096 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:23.192564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:23.193213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:23.193495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:23.193764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] PATH_INFO: `/v3/users/17fef10209c64f4586af72ee0dab9749` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:23.194950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fef10209c64f4586af72ee0dab9749)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:23.196917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:23.364264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fef10209c64f4586af72ee0dab9749'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.364977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fef10209c64f4586af72ee0dab9749'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.365612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fef10209c64f4586af72ee0dab9749'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.373641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fef10209c64f4586af72ee0dab9749'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.441546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d25f9c41-3f0f-452d-b8c5-63849f4067e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fef10209c64f4586af72ee0dab9749'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:23.462993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1240/2474] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:23 2022] DELETE /identity/v3/users/17fef10209c64f4586af72ee0dab9749 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:24.049680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.051298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:24.067396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755925cf-7389-4fbf-bed6-2f84d0011102 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.130240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.130865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.131175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.131448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] PATH_INFO: `/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.132600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afee3e50aa24b46a82aaf1aaeb28aa2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.134516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.270141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afee3e50aa24b46a82aaf1aaeb28aa2', 'request_id': 'req-f2c6cbab-1412-4be7-911e-44627a2a668c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:24.275809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afee3e50aa24b46a82aaf1aaeb28aa2', 'request_id': 'req-f2c6cbab-1412-4be7-911e-44627a2a668c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:24.332251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afee3e50aa24b46a82aaf1aaeb28aa2', 'request_id': 'req-f2c6cbab-1412-4be7-911e-44627a2a668c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:24.344312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] The token cache is being invalidate because project 7afee3e50aa24b46a82aaf1aaeb28aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:24.344627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:24.345268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f2c6cbab-1412-4be7-911e-44627a2a668c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:24.346759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1235/2475] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:24 2022] DELETE /identity/v3/projects/7afee3e50aa24b46a82aaf1aaeb28aa2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:24.351710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.352181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.352276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.372260 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:24.373526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:24.402869 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:24.432482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1241/2476] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:24.440570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.440865 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.441139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.461045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:24.462269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:24.470910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1236/2477] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:24.475310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.486321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f99008-ba15-44ad-905c-8cc9cf4a433d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.490887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.491516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.491800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.492072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.492709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:24.493012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.494593 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.506359 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1242/2478] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:54:24.510464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.520407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8204543-e270-4718-ae91-7e40f7d74915 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.525111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.525714 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.525992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.526265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.526890 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.528902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.609808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1237/2479] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:24 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:24.614164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.625531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca7fa8-b843-4ff5-8d61-9a008865a733 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.686691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.687376 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.687658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.687932 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.688572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.690516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.770149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1243/2480] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:24 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:24.774379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.785482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568021-85a2-4257-afa9-102e3c5ff1f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.790286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.790873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.791182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.791452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.792084 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.796583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.803871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1238/2481] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:24.808412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.818618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21fd2-5b89-4e06-88cc-a714fc5afe23 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.823423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.824022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.824420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.824714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.825328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.827679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c75ded-9eee-40d8-83ec-823f5abd300f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.838679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1244/2482] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:24.844207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:24.854083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd2a-2ef0-459a-b105-258194c9cb8e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:24.858886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:24.859556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.859835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.860103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] PATH_INFO: `/v3/projects/ec5b0b6cda09407c83eb0653446b14de/users/93ac31b683c94decbe3df0e0b3366447/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:24.874591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b0b6cda09407c83eb0653446b14de, user_id=93ac31b683c94decbe3df0e0b3366447, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:24.877303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:24.960101 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1239/2483] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:24 2022] PUT /identity/v3/projects/ec5b0b6cda09407c83eb0653446b14de/users/93ac31b683c94decbe3df0e0b3366447/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:24.972654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088f39-31a7-4c37-98e3-220210953371 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:24.972955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088f39-31a7-4c37-98e3-220210953371 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:24.973223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088f39-31a7-4c37-98e3-220210953371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.001891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-80088f39-31a7-4c37-98e3-220210953371 None None] MFA Rules not processed for user `93ac31b683c94decbe3df0e0b3366447`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:25.003176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80088f39-31a7-4c37-98e3-220210953371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:25.067973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1245/2484] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:54:25.073020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.106288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:25.145907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf23e-043f-4190-8e5f-89a832c9cc05 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.150773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.151423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.151716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.151995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.152631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.154683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.249156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1240/2485] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:25 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:25.253406 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088f39-31a7-4c37-98e3-220210953371 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.265365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088f39-31a7-4c37-98e3-220210953371 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.293814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:25.321320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.321930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.322212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.322486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.323239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.325614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.429942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1246/2486] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:25 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:25.433940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.445001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756704-1ab9-4f1b-bff7-74e253479f1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.449697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.450296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.450572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.450845 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.451541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.453170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.464102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1241/2487] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:25.468827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.478969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e253e3-9318-4519-ae31-4bae04c53271 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.484939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.485601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.485891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.486173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] PATH_INFO: `/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c/users/e4d0a5f1b99b4a3ba84acc6123ca76ed/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.502450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae3fba0d934c45ab7acca8c6cc0c5c, user_id=e4d0a5f1b99b4a3ba84acc6123ca76ed, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.505166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.573625 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1247/2488] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:25 2022] PUT /identity/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c/users/e4d0a5f1b99b4a3ba84acc6123ca76ed/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:25.577662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.588687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08c01-d7c8-4b19-abba-f35cbb10b20f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.649356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.649964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.650244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.650522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.651200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.652810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725014e-ea57-4936-ad95-94adc3cebb49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.663686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1242/2489] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:25.667887 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.679348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbef61-d916-4ddb-8269-6720b418c937 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.684047 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.684634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.684909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.685181 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] PATH_INFO: `/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c/users/e4d0a5f1b99b4a3ba84acc6123ca76ed/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.688018 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae3fba0d934c45ab7acca8c6cc0c5c, user_id=e4d0a5f1b99b4a3ba84acc6123ca76ed, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.690629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.701158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1248/2490] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:25 2022] PUT /identity/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c/users/e4d0a5f1b99b4a3ba84acc6123ca76ed/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:25.711719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.712065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.712276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.742760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] MFA Rules not processed for user `e4d0a5f1b99b4a3ba84acc6123ca76ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:25.744034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:25.821087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1243/2491] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:25.833101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:25.834861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:25.895536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89129-6b28-4dd5-903a-e89649f2df69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:25.899463 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:25.900081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:25.900381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:25.900656 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:25.911278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:25.912122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:25.923354 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1249/2492] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:26.083689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:26.085149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:26.098540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356ebe-318d-406c-9152-b7ca9f830bf0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:26.102390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:26.103001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:26.103309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:26.103580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:26.126603 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:26.172877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:26.174340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c56d07-0097-484c-8f22-37fcb2f8afab service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:26.184151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1244/2493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:31.205479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:31.270343 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e6d5a-f650-42b5-b0bd-dc7a99b10ff0 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:31.275007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:31.275721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:31.276004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:31.276276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] PATH_INFO: `/v3/users/93ac31b683c94decbe3df0e0b3366447` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:31.277420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ac31b683c94decbe3df0e0b3366447)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:31.279410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:31.360840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:31.474251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ac31b683c94decbe3df0e0b3366447'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:31.475038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ac31b683c94decbe3df0e0b3366447'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:31.475981 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ac31b683c94decbe3df0e0b3366447'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:31.483363 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ac31b683c94decbe3df0e0b3366447'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:31.579333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ac31b683c94decbe3df0e0b3366447'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:31.601390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1250/2494] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:31 2022] DELETE /identity/v3/users/93ac31b683c94decbe3df0e0b3366447 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:31.606070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:31.606544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:31.606641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:31.626569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:31.627738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:31.691602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1245/2495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:31.701513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:31.703516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:31.767602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a19033-dc17-4330-98bf-d44ac67d835e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:31.771264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:31.771875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:31.772147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:31.772418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:31.783582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:31.785089 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:31.795644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1251/2496] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:32.246510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:32.248039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:32.266976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a822-dc78-4f45-8656-b09b6be313da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:32.271740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:32.273190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:32.273481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:32.273754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] PATH_INFO: `/v3/projects/ec5b0b6cda09407c83eb0653446b14de` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:32.274965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5b0b6cda09407c83eb0653446b14de)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:32.276985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:32.429107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5b0b6cda09407c83eb0653446b14de', 'request_id': 'req-837605ab-f503-43bd-bd3f-ec81ecce866b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.454617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5b0b6cda09407c83eb0653446b14de', 'request_id': 'req-837605ab-f503-43bd-bd3f-ec81ecce866b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.587174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5b0b6cda09407c83eb0653446b14de', 'request_id': 'req-837605ab-f503-43bd-bd3f-ec81ecce866b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.600499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] The token cache is being invalidate because project ec5b0b6cda09407c83eb0653446b14de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:32.600788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.601515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.603022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1246/2497] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:32 2022] DELETE /identity/v3/projects/ec5b0b6cda09407c83eb0653446b14de => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:32.607165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:32.617745 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d095f-3668-4147-9eb1-4249dfaa0b8d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:32.689421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:32.696596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:32.696596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:32.696596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] PATH_INFO: `/v3/users/e4d0a5f1b99b4a3ba84acc6123ca76ed` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:32.696596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d0a5f1b99b4a3ba84acc6123ca76ed)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:32.696596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:32.888987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d0a5f1b99b4a3ba84acc6123ca76ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.889650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d0a5f1b99b4a3ba84acc6123ca76ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.890281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d0a5f1b99b4a3ba84acc6123ca76ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.892426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:32.897795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d0a5f1b99b4a3ba84acc6123ca76ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.977026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-004e5436-b21a-4b8f-a14a-947738bae4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d0a5f1b99b4a3ba84acc6123ca76ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:32.998076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1252/2498] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:32 2022] DELETE /identity/v3/users/e4d0a5f1b99b4a3ba84acc6123ca76ed => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:33.493917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:33.495641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:33.511074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837605ab-f503-43bd-bd3f-ec81ecce866b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:33.563401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:33.581425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:33.585519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:33.585519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:33.585519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] PATH_INFO: `/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:33.585519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ae3fba0d934c45ab7acca8c6cc0c5c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:33.586002 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:33.699916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ae3fba0d934c45ab7acca8c6cc0c5c', 'request_id': 'req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:33.866242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ae3fba0d934c45ab7acca8c6cc0c5c', 'request_id': 'req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:33.898460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ae3fba0d934c45ab7acca8c6cc0c5c', 'request_id': 'req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:33.910748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] The token cache is being invalidate because project 48ae3fba0d934c45ab7acca8c6cc0c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:33.911039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:33.911730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b3ca4941-f2e4-48b3-bde0-c8780ed48c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:33.913511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1247/2499] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:33 2022] DELETE /identity/v3/projects/48ae3fba0d934c45ab7acca8c6cc0c5c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:33.918676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:33.919191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:33.919301 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:33.942013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:33.943435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:34.005029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1253/2500] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:34.014432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.015508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.015508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.035752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:34.036976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:34.045488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1248/2501] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:34.050629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.060527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931970bb-5d0b-4b61-89b5-8012aa69255d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.066471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.067114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.067452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.067657 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.068332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:34.068654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.070497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.084084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1254/2502] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:54:34.088720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.099051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5f28-ff2d-48d3-a70b-6def91fd2d8c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.104888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.104888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.104888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.105364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.106211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.108409 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.206174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1249/2503] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:34.210355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.221329 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608619-d6a0-4bc8-967b-0f1d9d3aa01c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.280930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.281550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.281824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.282090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.282868 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.284819 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.371204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1255/2504] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:34.375886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.387007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece317-0946-4d4e-b246-016378e24b51 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.393229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.393853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.394184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.394515 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.395271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.396985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.424751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1250/2505] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:34.425972 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.436654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25f6b-2020-428b-a464-5929a2ca1504 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.443737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.445964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.445964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.445964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.445964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.447330 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bee638-9273-420d-b0b4-fe58abb37117 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.460193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1256/2506] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:34.465312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.484272 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74efe-0309-4ddb-8a0c-1557df8512e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.492249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.493421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.493916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.494417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] PATH_INFO: `/v3/projects/e99a089b0ad14a8fbff4dc03258953e4/users/32735526c59e46d6bf4a60888a9ba8e6/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.512853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99a089b0ad14a8fbff4dc03258953e4, user_id=32735526c59e46d6bf4a60888a9ba8e6, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.515748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.624989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1251/2507] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:34 2022] PUT /identity/v3/projects/e99a089b0ad14a8fbff4dc03258953e4/users/32735526c59e46d6bf4a60888a9ba8e6/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:34.635672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.635958 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.636225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.667147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] MFA Rules not processed for user `32735526c59e46d6bf4a60888a9ba8e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:34.668388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:34.691156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:34.740920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1257/2508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:34.745568 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.816014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49320ee2-52f3-441d-b51f-6cdaa2fe79e8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:34.821224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:34.821861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:34.822176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:34.822539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:34.823235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:34.825206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:34.838329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:34.970410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1252/2509] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:34.975263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:34.986767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1a96-aa7f-4af8-b137-e5bcad31d491 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.060055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.060697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.060973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.061241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.062553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.064854 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.207456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1258/2510] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:34 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:35.211695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.225998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58580a50-d8aa-4000-922f-27ac53ffbfc7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.230597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.231244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.231524 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.231794 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.232441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.234746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.245032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1253/2511] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:35.250867 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.261752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22593e2-674b-430e-9023-1b04ac7d33f4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.268381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.268381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.268381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.268381 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.268798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.270389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b88f5-82fc-4a52-8994-59b16e4aa4af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.281013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1259/2512] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:35.286066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.298015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d822-2096-477d-b094-3a7ba652c925 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.303010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.303731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.304008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.304283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] PATH_INFO: `/v3/projects/2593c6deaa8a4cb2993e049313b6c901/users/b914a72f0fcb48b78a95f50e47c916f2/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.320883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2593c6deaa8a4cb2993e049313b6c901, user_id=b914a72f0fcb48b78a95f50e47c916f2, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.323647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.424798 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1254/2513] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:35 2022] PUT /identity/v3/projects/2593c6deaa8a4cb2993e049313b6c901/users/b914a72f0fcb48b78a95f50e47c916f2/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:35.435606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.435924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.436154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.468579 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] MFA Rules not processed for user `b914a72f0fcb48b78a95f50e47c916f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:35.469680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:35.546916 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1260/2514] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:35.551901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.620156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10e8f-59f4-4afe-a41c-8bee56d4754b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.626047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.626667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.626950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.627265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.627972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.629940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.717394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1255/2515] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:35 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:35.722905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.737142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9e23-b0c1-4b15-adee-09e71c7a57bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.770773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:35.801939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.802617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.803014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.803360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.804095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.806388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.887516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1261/2516] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:35 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:35.891898 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.903589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0740-0b8e-4237-b932-90a625e95ee1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.909033 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.909666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.909956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.910241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.910920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.912878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:35.926520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1256/2517] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:35.931588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:35.950949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d042-1daa-44fe-a646-611419b49a5d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:35.960493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:35.961658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:35.962133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:35.962613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] PATH_INFO: `/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b/users/58b55224d496482ab125f6d688acf21c/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:35.992309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3483235ac3cc4dc99f7e8817b50b5c6b, user_id=58b55224d496482ab125f6d688acf21c, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:35.998986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:36.112670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1262/2518] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:35 2022] PUT /identity/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b/users/58b55224d496482ab125f6d688acf21c/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:36.116892 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:36.132364 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0599-6fe7-406b-ac54-08deda3602f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:36.206985 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:36.207797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:36.208178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:36.208552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:36.209327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:36.211078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92451e4c-fd05-422e-857a-714d2cffe574 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:36.222591 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1257/2519] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:54:36.226966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:36.238281 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa4528-09f6-415c-ac46-606a0f5b6584 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:36.243399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16037-1229-4393-9428-656fe86abded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:36.244072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16037-1229-4393-9428-656fe86abded admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:36.244373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16037-1229-4393-9428-656fe86abded admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:36.244642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16037-1229-4393-9428-656fe86abded admin admin] PATH_INFO: `/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b/users/58b55224d496482ab125f6d688acf21c/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:36.246582 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b16037-1229-4393-9428-656fe86abded admin admin] RBAC: Authorizing `identity:create_grant(project_id=3483235ac3cc4dc99f7e8817b50b5c6b, user_id=58b55224d496482ab125f6d688acf21c, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:36.250660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b16037-1229-4393-9428-656fe86abded admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:36.261526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1263/2520] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:36 2022] PUT /identity/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b/users/58b55224d496482ab125f6d688acf21c/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:36.274071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:36.274349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:36.274630 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:36.321690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] MFA Rules not processed for user `58b55224d496482ab125f6d688acf21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:36.323921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:36.338966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:36.412209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1258/2521] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:36.424838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16037-1229-4393-9428-656fe86abded admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:36.426629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99b16037-1229-4393-9428-656fe86abded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:36.493239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16037-1229-4393-9428-656fe86abded admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:36.497331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:36.497965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:36.498246 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:36.498547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:36.510824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:36.512314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:36.523357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1264/2522] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:36.634822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:36.636348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:36.650510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2dbc2-9ffc-4431-bc1b-d49ce87a6513 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:36.654641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:36.656391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:36.663181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:36.663181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:36.736995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:36.738459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:36.749992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1259/2523] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:40.399942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:40.401592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:40.465261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6a6-eae5-4ab5-9848-84cad8341ea2 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:40.469824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:40.470456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:40.470734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:40.471004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:40.472945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:40.521094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:40.553333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:40.554799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62de3fb-e736-4c76-927d-39a9f4ec541c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:40.568369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1265/2524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:41.072795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:41.148330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107e189-94ee-4748-8fde-c9d8da9c2643 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:41.153279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:41.153930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:41.154214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:41.154491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] PATH_INFO: `/v3/users/32735526c59e46d6bf4a60888a9ba8e6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:41.156465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32735526c59e46d6bf4a60888a9ba8e6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:41.158420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:41.367268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:41.369084 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32735526c59e46d6bf4a60888a9ba8e6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:41.369787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32735526c59e46d6bf4a60888a9ba8e6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:41.370428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32735526c59e46d6bf4a60888a9ba8e6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:41.378395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32735526c59e46d6bf4a60888a9ba8e6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:41.391989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32735526c59e46d6bf4a60888a9ba8e6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:41.481111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1260/2525] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:41 2022] DELETE /identity/v3/users/32735526c59e46d6bf4a60888a9ba8e6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:41.486539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:41.487355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:41.487355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:41.506387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:41.507708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:41.568822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1266/2526] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:54:41.578957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:41.580453 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:41.645721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2215fbe-916c-4cdd-be24-21e10a6e31a1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:41.649349 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:41.649963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:41.650242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:41.650519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:41.660753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:41.662221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:41.673449 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1261/2527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:41.766612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:41.776985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43ebe-496d-45a2-a755-9efdc6c6b8d1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:41.781695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:41.782563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:41.782669 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:41.782950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:41.784812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:41.864382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:41.865821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:41.877774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1267/2528] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:42.150445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:42.152020 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:42.166949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f9a3-7ad0-4b78-962c-eec256bd3fc7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:42.173258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:42.173911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:42.174192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:42.174470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] PATH_INFO: `/v3/projects/e99a089b0ad14a8fbff4dc03258953e4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:42.175863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99a089b0ad14a8fbff4dc03258953e4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:42.177861 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:42.293087 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99a089b0ad14a8fbff4dc03258953e4', 'request_id': 'req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.300795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99a089b0ad14a8fbff4dc03258953e4', 'request_id': 'req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.372376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99a089b0ad14a8fbff4dc03258953e4', 'request_id': 'req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.386264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] The token cache is being invalidate because project e99a089b0ad14a8fbff4dc03258953e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:42.386547 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.387263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.388870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1262/2529] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:42 2022] DELETE /identity/v3/projects/e99a089b0ad14a8fbff4dc03258953e4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:42.392986 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:42.404254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473dcea-84e4-4edd-baea-ac80939edab9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:42.474153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:42.486982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:42.494069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:42.494069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:42.494069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] PATH_INFO: `/v3/users/b914a72f0fcb48b78a95f50e47c916f2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:42.494069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b914a72f0fcb48b78a95f50e47c916f2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:42.494827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:42.763731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b914a72f0fcb48b78a95f50e47c916f2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.764394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b914a72f0fcb48b78a95f50e47c916f2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.765628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b914a72f0fcb48b78a95f50e47c916f2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.775150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b914a72f0fcb48b78a95f50e47c916f2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.855592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b914a72f0fcb48b78a95f50e47c916f2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:42.880949 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1268/2530] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:42 2022] DELETE /identity/v3/users/b914a72f0fcb48b78a95f50e47c916f2 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:43.362274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:43.365981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:43.434385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e130b-0b27-43dc-9d97-bc3be30c6e11 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:43.517056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:43.531995 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:43.532783 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:43.533143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:43.533489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] PATH_INFO: `/v3/projects/2593c6deaa8a4cb2993e049313b6c901` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:43.534844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2593c6deaa8a4cb2993e049313b6c901)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:43.537007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:43.691545 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2593c6deaa8a4cb2993e049313b6c901', 'request_id': 'req-37b7e72a-e28e-47ad-b15c-a2f664af0c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:43.699347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2593c6deaa8a4cb2993e049313b6c901', 'request_id': 'req-37b7e72a-e28e-47ad-b15c-a2f664af0c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:43.777964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2593c6deaa8a4cb2993e049313b6c901', 'request_id': 'req-37b7e72a-e28e-47ad-b15c-a2f664af0c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:43.792819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] The token cache is being invalidate because project 2593c6deaa8a4cb2993e049313b6c901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:43.793206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:43.793899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:43.798426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1263/2531] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:43 2022] DELETE /identity/v3/projects/2593c6deaa8a4cb2993e049313b6c901 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:43.799923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:43.801382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:43.833872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7277b0-f8b3-407d-aed6-31e811fa2139 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:43.905646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:43.906507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:43.906786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:43.907254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] PATH_INFO: `/v3/users/58b55224d496482ab125f6d688acf21c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:43.909308 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b55224d496482ab125f6d688acf21c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:43.913398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:44.143345 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b55224d496482ab125f6d688acf21c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:44.144310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b55224d496482ab125f6d688acf21c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:44.145092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b55224d496482ab125f6d688acf21c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:44.161202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b55224d496482ab125f6d688acf21c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:44.229555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c21262f-1499-4af9-8f5c-dba9f85e79dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b55224d496482ab125f6d688acf21c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:44.244170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:44.255753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1269/2532] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:43 2022] DELETE /identity/v3/users/58b55224d496482ab125f6d688acf21c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:44.866146 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:44.867791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:44.882674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7e72a-e28e-47ad-b15c-a2f664af0c38 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:44.949300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:44.949851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:44.950140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:44.950414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] PATH_INFO: `/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:44.951577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3483235ac3cc4dc99f7e8817b50b5c6b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:44.953651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.059194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3483235ac3cc4dc99f7e8817b50b5c6b', 'request_id': 'req-f4cc6837-d68d-48d7-af9c-d6db951a3e61'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:45.065482 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3483235ac3cc4dc99f7e8817b50b5c6b', 'request_id': 'req-f4cc6837-d68d-48d7-af9c-d6db951a3e61'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:45.128044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3483235ac3cc4dc99f7e8817b50b5c6b', 'request_id': 'req-f4cc6837-d68d-48d7-af9c-d6db951a3e61'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:45.140633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] The token cache is being invalidate because project 3483235ac3cc4dc99f7e8817b50b5c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:45.140923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:45.141571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4cc6837-d68d-48d7-af9c-d6db951a3e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:45.143168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1264/2533] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:44 2022] DELETE /identity/v3/projects/3483235ac3cc4dc99f7e8817b50b5c6b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:45.149257 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.149814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.149814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.169915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:45.171697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:45.238957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1270/2534] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:45.247426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.247711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.247987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.267879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:45.269096 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:45.277083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1265/2535] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:45.282338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.292523 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c5c68-5288-4627-8048-31826cf30144 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.298094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.298735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.299012 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.299331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.299980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:45.300284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.301904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.314730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1271/2536] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:54:45.319392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.323883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:45.329765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdc039-ca26-401d-9d3d-82c10d577029 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.338654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.340674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.340674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.340674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.340674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.343356 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.451942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1266/2537] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:45 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:54:45.456346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.466402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282bd2d-3d85-450e-9647-f4cb189655a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.528795 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.529410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.529694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.530520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.531272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.533491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.665863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1272/2538] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:45 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:45.670046 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.682917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a59c99-afaa-4552-9270-b3e84d099bc1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.688206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.688888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.689229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.689527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.690181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.691823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.705390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1267/2539] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:45.709487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.721287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354ec1f-f6c8-479d-a2f1-c5fd51cc5a24 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.726041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.726824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.726948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.727191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.727831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.729476 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5e3d2-d60d-4c56-8597-b4e42cdce3aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.741226 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1273/2540] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:45.745713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:45.765692 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f05f-00c6-411c-b38f-95174216f403 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:45.777909 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:45.778762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.779114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.779346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] PATH_INFO: `/v3/projects/81a6914a961147f082a916ca98a41dd2/users/d1ad288150474c00b1bc18ea6bfdcc6d/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.798072 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6914a961147f082a916ca98a41dd2, user_id=d1ad288150474c00b1bc18ea6bfdcc6d, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:45.800977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:45.886035 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1268/2541] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:45 2022] PUT /identity/v3/projects/81a6914a961147f082a916ca98a41dd2/users/d1ad288150474c00b1bc18ea6bfdcc6d/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:45.899215 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:45.899632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:45.899811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:45.936594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] MFA Rules not processed for user `d1ad288150474c00b1bc18ea6bfdcc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:45.937974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:45.988115 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:46.016818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1274/2542] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:46.018193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.087574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0cc-1a36-4194-a4ce-76bf803669a3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.092322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.093394 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.093681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.093973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.094609 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.096548 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.225841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1269/2543] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:46 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:46.227144 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.238834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42fc2-eddd-4069-a755-b83b21884135 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.304944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.305561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.305836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.306106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.306893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.309005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.395182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1275/2544] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:46 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:46.399311 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.410348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e81e5-73a8-48b3-9603-0769a715716f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.415474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.419070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.419070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.419070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.419070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.419070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.430632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1270/2545] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:46.434959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.446522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981bd76-df87-496b-95c6-996e1057720c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.451067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.451733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.452097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.452598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] PATH_INFO: `/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e/users/782292fd350946efa645ed7ee23434c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.468803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae1a41677b74b9990e5f66a0d5c097e, user_id=782292fd350946efa645ed7ee23434c4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.471480 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.548924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1276/2546] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:46 2022] PUT /identity/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e/users/782292fd350946efa645ed7ee23434c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:46.552648 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.565308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb9ae-f2f1-4436-b008-8d0c5514beb6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.630347 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.630954 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.631278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.631550 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.632226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.633818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec463-7afd-4dbe-bc52-30bfcf8a2d01 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.643641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1271/2547] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:46.648529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.659320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e7e8-83dd-4ff4-800d-fe284e894d99 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.664302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.664940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.665245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.665513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] PATH_INFO: `/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e/users/782292fd350946efa645ed7ee23434c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.667487 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae1a41677b74b9990e5f66a0d5c097e, user_id=782292fd350946efa645ed7ee23434c4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.670187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.682005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1277/2548] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:46 2022] PUT /identity/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e/users/782292fd350946efa645ed7ee23434c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:46.699623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.699911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.700190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.730784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] MFA Rules not processed for user `782292fd350946efa645ed7ee23434c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:46.732241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:46.737399 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:46.806675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1272/2549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:46.818460 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:46.820190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:46.880310 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4ce1d-e96f-4121-bc20-cb0ec8ef32f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:46.884128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:46.884740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:46.885051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:46.885350 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:46.894927 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:46.896399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75598-41a2-4ec2-895d-eb893690ffd6 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:46.906607 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1278/2550] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:48.209731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:48.279696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7173-3b99-49af-a1f3-2f0fe4f60cdf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:48.284787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:48.285450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:48.285748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:48.286015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] PATH_INFO: `/v3/users/d1ad288150474c00b1bc18ea6bfdcc6d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:48.287210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ad288150474c00b1bc18ea6bfdcc6d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:48.289537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:48.618730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ad288150474c00b1bc18ea6bfdcc6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:48.619810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ad288150474c00b1bc18ea6bfdcc6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:48.620810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ad288150474c00b1bc18ea6bfdcc6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:48.634256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ad288150474c00b1bc18ea6bfdcc6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:48.650023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ad288150474c00b1bc18ea6bfdcc6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:48.760808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1273/2551] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:48 2022] DELETE /identity/v3/users/d1ad288150474c00b1bc18ea6bfdcc6d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:48.766065 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:48.766588 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:48.766688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:48.788134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:48.789286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:48.830574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:48.852006 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1279/2552] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:48.861858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:48.863333 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:48.886710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:48.926326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129575b1-9d85-41f5-a1ca-e8f412e26375 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:48.930029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:48.930651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:48.930928 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:48.931259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:48.941245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:48.942759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:48.954152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1274/2553] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:49.486032 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:49.489925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:49.510485 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed949eb-c89f-4a49-80f3-d5b21ce81247 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:49.518693 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:49.519644 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:49.520156 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:49.520573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] PATH_INFO: `/v3/projects/81a6914a961147f082a916ca98a41dd2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:49.521857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a6914a961147f082a916ca98a41dd2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:49.523817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:49.731759 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a6914a961147f082a916ca98a41dd2', 'request_id': 'req-3804bc45-e328-4633-a8fc-9fe08af9abcd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:49.741366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a6914a961147f082a916ca98a41dd2', 'request_id': 'req-3804bc45-e328-4633-a8fc-9fe08af9abcd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:49.754737 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a6914a961147f082a916ca98a41dd2', 'request_id': 'req-3804bc45-e328-4633-a8fc-9fe08af9abcd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:49.847061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] The token cache is being invalidate because project 81a6914a961147f082a916ca98a41dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:49.847720 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:49.848185 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:49.849688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1280/2554] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:49 2022] DELETE /identity/v3/projects/81a6914a961147f082a916ca98a41dd2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:49.853922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:49.864396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69398-61b3-4cbf-85cd-ac38c9d4c492 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:49.931105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:49.932180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:49.932501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:49.932775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] PATH_INFO: `/v3/users/782292fd350946efa645ed7ee23434c4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:49.933962 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] RBAC: Authorizing `identity:delete_user(user_id=782292fd350946efa645ed7ee23434c4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:49.937222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:50.253977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782292fd350946efa645ed7ee23434c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:50.255066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782292fd350946efa645ed7ee23434c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:50.256040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782292fd350946efa645ed7ee23434c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:50.269171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782292fd350946efa645ed7ee23434c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:50.294295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782292fd350946efa645ed7ee23434c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:50.382419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1275/2555] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:49 2022] DELETE /identity/v3/users/782292fd350946efa645ed7ee23434c4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:50.770804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:50.773154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:50.916046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bc45-e328-4633-a8fc-9fe08af9abcd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:50.999494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:51.000709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.000996 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.001288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.003137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:51.061987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:51.120254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:51.123339 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f478-0e35-40ff-b1a5-9a4199164c41 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:51.143640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1281/2556] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:51.198655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:51.200846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:51.219551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038936a-1fd3-4dde-a02b-864aceb4362d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:51.226835 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:51.228301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.228777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.229256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] PATH_INFO: `/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.231668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae1a41677b74b9990e5f66a0d5c097e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:51.235204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:51.382475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:51.397121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae1a41677b74b9990e5f66a0d5c097e', 'request_id': 'req-e4882a12-a554-4169-96c2-2526ddc38ef7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:51.405577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae1a41677b74b9990e5f66a0d5c097e', 'request_id': 'req-e4882a12-a554-4169-96c2-2526ddc38ef7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:51.521377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae1a41677b74b9990e5f66a0d5c097e', 'request_id': 'req-e4882a12-a554-4169-96c2-2526ddc38ef7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:51.541045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] The token cache is being invalidate because project 6ae1a41677b74b9990e5f66a0d5c097e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:51.541350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:51.543525 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e4882a12-a554-4169-96c2-2526ddc38ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:51.545181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1276/2557] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:51 2022] DELETE /identity/v3/projects/6ae1a41677b74b9990e5f66a0d5c097e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:51.551106 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79260-104b-4892-9cc7-49df018af141 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.551360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79260-104b-4892-9cc7-49df018af141 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.551653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79260-104b-4892-9cc7-49df018af141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.585232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63a79260-104b-4892-9cc7-49df018af141 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:51.586749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63a79260-104b-4892-9cc7-49df018af141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:51.683611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1282/2558] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:51.693656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.693942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.694221 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.720938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:51.722220 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:51.731911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1277/2559] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:51.738361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a79260-104b-4892-9cc7-49df018af141 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:51.752681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a79260-104b-4892-9cc7-49df018af141 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:51.759501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:51.760207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.760560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.760906 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.761648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:51.762749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:51.765029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:51.785083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1283/2560] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:54:51.791699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:51.797560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9591ca-7b50-492e-a925-0afedba01805 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:51.803611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:51.804328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:51.804613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:51.804884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:51.805518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:51.807485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:51.909507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1278/2561] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:51 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:51.915728 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:51.927017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bdd6d-bec8-4972-8bd7-d0a7327d1443 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.009697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.010497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.010785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.011062 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.011752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.013704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.097465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1284/2562] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:51 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:52.101562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:52.127470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579152b-2c8b-467d-bc92-84b50aaccfd4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.135636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.136318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.136606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.136876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.141129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.141129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.160490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1279/2563] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:52.164498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:52.175393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6762f34-95b7-4d2b-aa3b-37bbd257978f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.181228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.182114 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.182388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.182842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.183559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.185312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503891ef-3885-4c7b-8130-1aa44a0044d7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.202442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:52.207667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1285/2564] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:52.213830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575248-b7a2-4003-9f88-fa6934a22525 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.223619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.224318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.224597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.225483 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] PATH_INFO: `/v3/projects/64ee23e08f67479fa4a2a2b725c20ef8/users/7d7a8b9af2274798bf31a94bf4a4a318/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.248945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ee23e08f67479fa4a2a2b725c20ef8, user_id=7d7a8b9af2274798bf31a94bf4a4a318, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.248945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.344621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1280/2565] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:52 2022] PUT /identity/v3/projects/64ee23e08f67479fa4a2a2b725c20ef8/users/7d7a8b9af2274798bf31a94bf4a4a318/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:52.356265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.356552 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.356832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.408413 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] MFA Rules not processed for user `7d7a8b9af2274798bf31a94bf4a4a318`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:52.410126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:52.463380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:52.515496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1286/2566] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:52.519617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:52.612231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad195547-2551-455e-8ab5-77c613e1d5ef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.617691 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.618330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.618654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.619032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.619737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.624457 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.783238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1281/2567] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:52 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:52.784327 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:52.796285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d71d0-80e9-4727-8360-ec60abcfe40c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:52.861617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:52.862253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:52.862531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:52.862800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:52.863484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:52.865541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:52.986680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1287/2568] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:52 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:52.988276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:53.000329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ab85-3ca4-47d8-8f91-3ab84f9618d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:53.006680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:53.007339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.007614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.007887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.008546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:53.010209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:53.021706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1282/2569] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:53.027140 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:53.038344 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89634a-e292-4631-9f85-0b4a2b275611 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:53.046697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:53.047715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.048149 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.048701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] PATH_INFO: `/v3/projects/a93f25cf60bb4ab2baa94e792fb99744/users/fdbaae25f457464cb6605c6a15cb43c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.066358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93f25cf60bb4ab2baa94e792fb99744, user_id=fdbaae25f457464cb6605c6a15cb43c4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:53.069102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:53.185212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1288/2570] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:53 2022] PUT /identity/v3/projects/a93f25cf60bb4ab2baa94e792fb99744/users/fdbaae25f457464cb6605c6a15cb43c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:53.189274 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:53.200442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e378-f715-4df5-8b15-8e6cd11c3e60 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:53.243602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:53.282441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:53.283310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.283687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.284055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.286560 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:53.288693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded702b-8e5d-409d-b42e-a68dbc707a10 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:53.311495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1283/2571] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:53.315555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:53.328880 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75194-af9a-4faf-a2fc-7603d25b784b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:53.335688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:53.335688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.337218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.337218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] PATH_INFO: `/v3/projects/a93f25cf60bb4ab2baa94e792fb99744/users/fdbaae25f457464cb6605c6a15cb43c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.338500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93f25cf60bb4ab2baa94e792fb99744, user_id=fdbaae25f457464cb6605c6a15cb43c4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:53.341973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:53.358011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1289/2572] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:53 2022] PUT /identity/v3/projects/a93f25cf60bb4ab2baa94e792fb99744/users/fdbaae25f457464cb6605c6a15cb43c4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:53.368921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.369215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.369493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.401788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] MFA Rules not processed for user `fdbaae25f457464cb6605c6a15cb43c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:53.403205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:53.506856 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1284/2573] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:53.515802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:53.518535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:53.589626 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7b42-a9cc-4b92-a5c1-e299978fd302 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:53.594392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:53.595207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:53.595494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:53.595771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:53.637331 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:53.665933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:53.667454 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:53.678696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1290/2574] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:55.673780 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:55.675335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:55.760855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682d65-3c0f-4cf5-8a1b-229f159920fc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:55.765929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:55.766624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:55.768256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:55.768256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] PATH_INFO: `/v3/users/5153ddc5d5e4480a81e636fba58821d5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:55.782287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5153ddc5d5e4480a81e636fba58821d5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:55.784283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:56.029383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5153ddc5d5e4480a81e636fba58821d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.030837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5153ddc5d5e4480a81e636fba58821d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.031738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5153ddc5d5e4480a81e636fba58821d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.033121 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:56.040997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5153ddc5d5e4480a81e636fba58821d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.053922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f378ab7-e8d2-45ff-b683-94c3356d2e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5153ddc5d5e4480a81e636fba58821d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.119635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1285/2575] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:55 2022] DELETE /identity/v3/users/5153ddc5d5e4480a81e636fba58821d5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:56.507664 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:56.522774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e981ce3-aef8-46e0-bad6-99dbc89882ac service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:56.590786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:56.591478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:56.591757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:56.592030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] PATH_INFO: `/v3/projects/a9c886c2349b4ea0a34b78d80737c4ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:56.604098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c886c2349b4ea0a34b78d80737c4ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:56.606112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:56.730751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c886c2349b4ea0a34b78d80737c4ce', 'request_id': 'req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.736802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c886c2349b4ea0a34b78d80737c4ce', 'request_id': 'req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.743493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c886c2349b4ea0a34b78d80737c4ce', 'request_id': 'req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.838412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] The token cache is being invalidate because project a9c886c2349b4ea0a34b78d80737c4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:56.838698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.839365 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d6625fbd-7b7c-4a46-b53b-d346bfdc0be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:56.840898 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1291/2576] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:56 2022] DELETE /identity/v3/projects/a9c886c2349b4ea0a34b78d80737c4ce => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:56.845976 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:56.847577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:56.847577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:56.867214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:56.868480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:56.943846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1286/2577] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:56.952136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:56.952419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:56.952690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:56.973455 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:56.974706 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:56.983612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1292/2578] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:56.987950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:56.997926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ac9c-4e54-4d99-a74e-5c76fcb25775 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.003513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.004135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.004418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.004694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.005383 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:54:57.005696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.009622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.020076 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1287/2579] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:54:57.024518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.034159 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132cfcb-b369-4fdc-a9d8-5f124868526e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.039298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.039913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.040193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.040465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.041082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.042998 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.073419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.075216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.088594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128b9d-b667-41c3-b7c4-f802be498b01 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.093625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.094238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.094517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.094789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] PATH_INFO: `/v3/users/7d7a8b9af2274798bf31a94bf4a4a318` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.095941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7a8b9af2274798bf31a94bf4a4a318)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.097947 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.175346 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1293/2580] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:54:57 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:57.179584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.218608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:57.257323 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ce0b-cc92-4186-a820-d1b4091be593 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.262513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.263269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.263553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.263829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.264781 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.266796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.356264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7a8b9af2274798bf31a94bf4a4a318'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:57.356917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7a8b9af2274798bf31a94bf4a4a318'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:57.357521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7a8b9af2274798bf31a94bf4a4a318'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:57.365814 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7a8b9af2274798bf31a94bf4a4a318'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:57.380993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1294/2581] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:54:57 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:54:57.380993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.381918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7a8b9af2274798bf31a94bf4a4a318'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:57.382034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.441255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe571d-5978-4c06-892c-b0f7dbd59056 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.444904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.445505 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.445785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.446056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.447833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.458288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1288/2582] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:57 2022] DELETE /identity/v3/users/7d7a8b9af2274798bf31a94bf4a4a318 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:57.459204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.460608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.461453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.462941 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0d8c-295f-4148-b119-1b413fea803d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.479166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1295/2583] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:57.479166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.479166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.479166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.494545 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:57.495814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.501154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:57.547530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f134f-7b9b-483c-91c2-394b763b8aa4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.553539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.554238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.554644 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.555517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.555913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.558310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.564630 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1296/2584] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:57.577584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1289/2585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:57.577788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.579055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.580150 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.595116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad960c-73e9-454a-a61d-29980bfdd28f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.602970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.603813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.604834 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.605191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.605963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.609188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.622327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1290/2586] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:54:57.628318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.640249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddca1-cdfa-4b84-b189-6e99dcd83962 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.645580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.650292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.650292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.650292 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] PATH_INFO: `/v3/projects/a4b0d89484544aa8934e98b2313bc520/users/2d9e72f5ebdc40e6821af403e4a070e2/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.656197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543bf4f-3022-48ce-bd30-81db25d10c46 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.660654 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.661358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.661650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.661930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.665289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b0d89484544aa8934e98b2313bc520, user_id=2d9e72f5ebdc40e6821af403e4a070e2, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.668669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.673938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:57.675783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27df8-b2e6-4b25-a502-aeb1a6f0c0e5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:57.688126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1297/2587] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:57.746777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1291/2588] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:54:57 2022] PUT /identity/v3/projects/a4b0d89484544aa8934e98b2313bc520/users/2d9e72f5ebdc40e6821af403e4a070e2/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:57.757624 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.758276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.758913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:57.767648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:57.794736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] MFA Rules not processed for user `2d9e72f5ebdc40e6821af403e4a070e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:57.796431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.875501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1298/2589] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:57.888202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:57.891288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:57.984969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e769b-bc17-4645-87cf-9c4ed0fc19eb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:57.992287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:57.992919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:57.993184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:57.993460 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:58.005180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:58.009532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:58.035300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1292/2590] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:54:58.260409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:58.260409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:58.314472 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:58.399535 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817dbcc-8047-4783-bed0-98611cadc61b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:58.409666 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:58.410700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:58.410959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:58.411269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] PATH_INFO: `/v3/projects/64ee23e08f67479fa4a2a2b725c20ef8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:58.413045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ee23e08f67479fa4a2a2b725c20ef8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:58.415196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:58.427737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653c86-b514-4a29-aa4d-0940f709e69d service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:58.437367 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:58.438145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:58.443105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:58.443105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] PATH_INFO: `/v3/users/2d9e72f5ebdc40e6821af403e4a070e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:58.443105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9e72f5ebdc40e6821af403e4a070e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:58.446238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:58.465820 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:58.682331 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9e72f5ebdc40e6821af403e4a070e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.683030 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9e72f5ebdc40e6821af403e4a070e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.683987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9e72f5ebdc40e6821af403e4a070e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.693514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ee23e08f67479fa4a2a2b725c20ef8', 'request_id': 'req-73de1c84-afe3-4c91-a208-c2d08e4506ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.694055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9e72f5ebdc40e6821af403e4a070e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.700822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ee23e08f67479fa4a2a2b725c20ef8', 'request_id': 'req-73de1c84-afe3-4c91-a208-c2d08e4506ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.709892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ee23e08f67479fa4a2a2b725c20ef8', 'request_id': 'req-73de1c84-afe3-4c91-a208-c2d08e4506ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.716658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7dd7e02-18fe-4a09-a8c6-6a27324656a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9e72f5ebdc40e6821af403e4a070e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.802197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] The token cache is being invalidate because project 64ee23e08f67479fa4a2a2b725c20ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:54:58.811619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.811619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:58.811619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1299/2591] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:58 2022] DELETE /identity/v3/projects/64ee23e08f67479fa4a2a2b725c20ef8 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:58.811619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:58.811619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:58.838770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:58.870919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1293/2592] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:58 2022] DELETE /identity/v3/users/2d9e72f5ebdc40e6821af403e4a070e2 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:54:58.872487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:58.873039 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:58.873713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:58.885683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1c84-afe3-4c91-a208-c2d08e4506ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:58.898486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:54:58.900001 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:58.961295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:58.962187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:58.962473 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:58.963017 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] PATH_INFO: `/v3/users/fdbaae25f457464cb6605c6a15cb43c4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:58.964273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbaae25f457464cb6605c6a15cb43c4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:58.966435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:58.978870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1294/2593] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:54:58.991323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:58.993051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:59.065681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc6c2-cef1-4120-a712-11016212d1da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:59.069553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:59.070176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:59.070454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:59.070724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:59.081743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:59.083305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:54:59.094850 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1295/2594] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:54:59.260352 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbaae25f457464cb6605c6a15cb43c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:59.261084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbaae25f457464cb6605c6a15cb43c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:59.261753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbaae25f457464cb6605c6a15cb43c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:59.272696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbaae25f457464cb6605c6a15cb43c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:59.376133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbaae25f457464cb6605c6a15cb43c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:54:59.399574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1300/2595] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:54:58 2022] DELETE /identity/v3/users/fdbaae25f457464cb6605c6a15cb43c4 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:54:59.810262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:54:59.812731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:54:59.831758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4e0a7-6fac-48a3-a642-c4bcdbc665d0 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:54:59.902579 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:59.962952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:54:59.964357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:54:59.964632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:54:59.964989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] PATH_INFO: `/v3/projects/a4b0d89484544aa8934e98b2313bc520` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:54:59.966282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b0d89484544aa8934e98b2313bc520)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:54:59.968871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.129783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.131848 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.149640 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40da3-510a-407e-aee4-5a023e6a602a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.165412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b0d89484544aa8934e98b2313bc520', 'request_id': 'req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.177450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b0d89484544aa8934e98b2313bc520', 'request_id': 'req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.207388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:00.221495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.222265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.227565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.227565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] PATH_INFO: `/v3/projects/a93f25cf60bb4ab2baa94e792fb99744` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.227565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93f25cf60bb4ab2baa94e792fb99744)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.227565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.246301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b0d89484544aa8934e98b2313bc520', 'request_id': 'req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.263145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] The token cache is being invalidate because project a4b0d89484544aa8934e98b2313bc520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:00.263532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.264730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be1f1b87-2eeb-4fcc-8806-e44d1300fd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.266577 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1296/2596] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:54:59 2022] DELETE /identity/v3/projects/a4b0d89484544aa8934e98b2313bc520 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:00.271467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b59d-6e90-4c3e-bc5d-2f9c1fc40f8d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.271740 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b59d-6e90-4c3e-bc5d-2f9c1fc40f8d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.272073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b59d-6e90-4c3e-bc5d-2f9c1fc40f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.296059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d0f9b59d-6e90-4c3e-bc5d-2f9c1fc40f8d None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:00.297424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d0f9b59d-6e90-4c3e-bc5d-2f9c1fc40f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.315276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1297/2597] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:00.319882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.320379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.320920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.347852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:00.349097 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.367895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93f25cf60bb4ab2baa94e792fb99744', 'request_id': 'req-389b3897-76d5-4fbf-9ba4-45f1bafde35f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.374441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93f25cf60bb4ab2baa94e792fb99744', 'request_id': 'req-389b3897-76d5-4fbf-9ba4-45f1bafde35f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.381564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93f25cf60bb4ab2baa94e792fb99744', 'request_id': 'req-389b3897-76d5-4fbf-9ba4-45f1bafde35f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.442227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1298/2598] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:00.447210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.457418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342465-6474-4a14-b7e0-1c064a852b4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.462455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.463100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.463387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.463666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.472939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:00.472939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.472939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.473218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] The token cache is being invalidate because project a93f25cf60bb4ab2baa94e792fb99744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:00.473218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.473218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-389b3897-76d5-4fbf-9ba4-45f1bafde35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:00.473218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1301/2599] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:00 2022] DELETE /identity/v3/projects/a93f25cf60bb4ab2baa94e792fb99744 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:00.476931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb315c5-5832-4d6b-b3fb-92723c6c3656 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.477335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb315c5-5832-4d6b-b3fb-92723c6c3656 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.477809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb315c5-5832-4d6b-b3fb-92723c6c3656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.485455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1299/2600] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:00.486765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.489213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.505452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ab3cf-4189-4685-b0c3-58b1e9bdd774 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.506338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6fb315c5-5832-4d6b-b3fb-92723c6c3656 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:00.507685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fb315c5-5832-4d6b-b3fb-92723c6c3656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.510908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.511450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.511775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.512008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.512647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.515206 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.516095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1302/2601] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:00.524005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.524366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.524711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.548182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:00.549408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:00.559534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1303/2602] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:00.564285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.574126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82add91-054a-40a7-89ee-e42ba0250642 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.579991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.580614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.580901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.581170 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.581895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:00.582143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.587424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.600611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1304/2603] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:00.605401 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.617275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702014-52bc-41c3-9420-a66e9c1b0181 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.627046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.627444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1300/2604] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:00.627722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.628051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.628386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.629472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.631474 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.631700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.718592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ebaf-d29a-4eb3-bf69-60c194e97e82 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.724448 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.726023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.726023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.726023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.726632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.728716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.739318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1305/2605] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:00.743481 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.760938 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:00.809790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eefba-3cc5-4660-beee-f027144eeeda admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.816046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.816638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.816918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.817192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.817818 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.819833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.849432 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1301/2606] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:00.854846 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.874419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd352e-a436-4ca7-91e9-835949ed0b56 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.883268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.883268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.883268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.883268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.884143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.885605 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.909158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1302/2607] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:00.914462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.931918 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778810-ec05-4fc9-8d2e-8ac3e4fbcc85 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.940461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.941553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.941989 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.942377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:00.943265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:00.945214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:00.961243 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1303/2608] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:00.965486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.973020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1306/2609] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:00 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:00.974953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:00.978760 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbe9f-d964-401e-a26d-af823461c0e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:00.986320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:00.987444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:00.987444 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:00.987765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] PATH_INFO: `/v3/projects/e794e8ddc4e4424d8adbd2aec20a0f2c/users/d6a59346f969467e94c63c45cfc525ed/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.008269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c18a-de5f-4e10-b47d-d591e11eb6f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.011354 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e794e8ddc4e4424d8adbd2aec20a0f2c, user_id=d6a59346f969467e94c63c45cfc525ed, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.015684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aed1-6006-4335-a5db-243cb26907ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.018531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.019261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.019550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.019830 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.020542 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.022477 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.043169 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1307/2610] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:01.045457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.069483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36caa7-4434-4120-9ceb-f4349ba87466 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.077970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.077970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.079250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.079543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.080219 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.082020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.098084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1308/2611] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:01.103207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.115886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d08c1-b6ba-4128-a297-7f900664fa0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.121472 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.122141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.122440 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.123117 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] PATH_INFO: `/v3/projects/7ccd204b1cb843c2b3f0776bf3337345/users/66ed946148bb456a9cdf78dde8e7071f/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.142703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccd204b1cb843c2b3f0776bf3337345, user_id=66ed946148bb456a9cdf78dde8e7071f, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.146440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1304/2612] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:00 2022] PUT /identity/v3/projects/e794e8ddc4e4424d8adbd2aec20a0f2c/users/d6a59346f969467e94c63c45cfc525ed/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:01.147753 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.158951 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac909-3570-427c-aa77-fb2ea016eadb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.159246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac909-3570-427c-aa77-fb2ea016eadb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.159473 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac909-3570-427c-aa77-fb2ea016eadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.202873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-636ac909-3570-427c-aa77-fb2ea016eadb None None] MFA Rules not processed for user `d6a59346f969467e94c63c45cfc525ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:01.204403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-636ac909-3570-427c-aa77-fb2ea016eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:01.270295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1309/2613] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:01 2022] PUT /identity/v3/projects/7ccd204b1cb843c2b3f0776bf3337345/users/66ed946148bb456a9cdf78dde8e7071f/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:01.316108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1305/2614] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:01.317639 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.337569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:01.343681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.343971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.344659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.388284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] MFA Rules not processed for user `66ed946148bb456a9cdf78dde8e7071f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:01.391026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:01.441060 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae7da-40c2-4406-b921-28a024bac411 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.447444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.448536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.449421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.449783 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.450514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.453126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.515012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1306/2615] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:01.527205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.530251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:01.603911 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:01.616684 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1310/2616] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:01 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:01.618912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.625229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61deb113-151c-44af-943f-fa2662034dd0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.706831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.707805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.708304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.708872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.744493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd8ef-d704-4167-afce-f3f590ce192b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.754884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.758506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.758506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.758506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.758506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.763680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.816125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.818083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.828952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1307/2617] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:01.890722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1311/2618] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:01 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:01.894942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.919308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc83b-2c07-41a6-8d19-0ba75be2223f service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.930476 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.931107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.931699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.931986 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.932778 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.934406 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:01.958246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1308/2619] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:01.958348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:01.973988 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d62b-8f9b-4d00-aef7-3f66542581ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:01.981608 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:01.983429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:01.984256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:01.984718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:01.985508 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:01.987591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.003514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1312/2620] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:02.015583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.030136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.037831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:02.039881 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356885f-7f6d-4e6b-8a8e-cb66019d68c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.047141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.047944 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.059446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.060575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] PATH_INFO: `/v3/projects/c07979e4fc5e4d1aa57daff88aab4ff2/users/64e1ba38a55f43d782a715156c3fd773/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.060991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c709-be02-42f2-9a2e-9ec1b5de6191 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.069850 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.070742 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.071136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.071525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] PATH_INFO: `/v3/users/e126e83baeee403f9d8f0ca39a75bb77` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.084133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07979e4fc5e4d1aa57daff88aab4ff2, user_id=64e1ba38a55f43d782a715156c3fd773, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.085271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9045d-896c-4a58-9c82-f19bdf805f73 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.088597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e126e83baeee403f9d8f0ca39a75bb77)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.091162 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.114719 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:02.225610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1309/2621] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:02 2022] PUT /identity/v3/projects/c07979e4fc5e4d1aa57daff88aab4ff2/users/64e1ba38a55f43d782a715156c3fd773/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:02.235823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.236116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.236440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.267106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] MFA Rules not processed for user `64e1ba38a55f43d782a715156c3fd773`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:02.268363 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:02.276932 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:02.334703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e126e83baeee403f9d8f0ca39a75bb77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.336014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e126e83baeee403f9d8f0ca39a75bb77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.336618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e126e83baeee403f9d8f0ca39a75bb77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.337696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1310/2622] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:02.342779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.346707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e126e83baeee403f9d8f0ca39a75bb77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.406239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8708-8eb9-4fa9-957e-f38f9580c52d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.410894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.411549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.411831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.412353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.413145 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.415065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.433433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e126e83baeee403f9d8f0ca39a75bb77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.455003 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1313/2623] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:02 2022] DELETE /identity/v3/users/e126e83baeee403f9d8f0ca39a75bb77 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:02.528400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1311/2624] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:02 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:02.533229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.534840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:02.611373 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e66d1-0451-45fa-b68b-ccf5cdda355c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.671613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.672568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.672568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.672862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.673430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.675554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.699884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.701623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:02.716840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adc37-931d-4fd1-9d85-13b8b75386ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.722134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.725768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.725768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.725768 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] PATH_INFO: `/v3/projects/18971fdb85434eb1bcea3759e997c5ed` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.737658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=18971fdb85434eb1bcea3759e997c5ed)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.739872 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.808412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1314/2625] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:02 2022] POST /identity/v3/users => generated 300 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:02.816024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.828040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04627030-6bd8-43b5-a90c-2a5b57b77682 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.833037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.833665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.833947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.834218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.834865 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.836599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.848908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1315/2626] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:02.854826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:02.865749 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5109bc-1e68-4bf6-8d1b-a270bd5d3f6e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:02.870827 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:02.871952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:02.872253 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:02.873773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] PATH_INFO: `/v3/projects/a2ba317876bb4ef292bac2f5f76ec380/users/5fcb2490b21b469db33c44849586c1c5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:02.891735 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ba317876bb4ef292bac2f5f76ec380, user_id=5fcb2490b21b469db33c44849586c1c5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:02.895798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:02.910549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18971fdb85434eb1bcea3759e997c5ed', 'request_id': 'req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.916318 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18971fdb85434eb1bcea3759e997c5ed', 'request_id': 'req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:02.983537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:02.988707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1316/2627] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:02 2022] PUT /identity/v3/projects/a2ba317876bb4ef292bac2f5f76ec380/users/5fcb2490b21b469db33c44849586c1c5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:02.992808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.040606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18971fdb85434eb1bcea3759e997c5ed', 'request_id': 'req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:03.053470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] The token cache is being invalidate because project 18971fdb85434eb1bcea3759e997c5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:03.054280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:03.054446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-575dd2cc-b33f-46e9-90ab-4f5f4933d2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:03.055997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1312/2628] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:02 2022] DELETE /identity/v3/projects/18971fdb85434eb1bcea3759e997c5ed => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:03.057603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6f3d-88d6-4f89-bcb3-ba54c268d4eb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.061247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50dd42-b53e-4d0c-82b5-93c88517074b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.061613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50dd42-b53e-4d0c-82b5-93c88517074b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.062268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50dd42-b53e-4d0c-82b5-93c88517074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.063752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.064366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.064647 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.064922 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.065599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.067233 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.079544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1317/2629] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:03.084601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.086149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3c50dd42-b53e-4d0c-82b5-93c88517074b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:03.088601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.088746 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3c50dd42-b53e-4d0c-82b5-93c88517074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.098217 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1313/2630] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:03.103955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf33-70e4-4fc1-a517-b719eac089ea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.106788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.107242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.107699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.109493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.110236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.110612 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.110963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] PATH_INFO: `/v3/projects/a2ba317876bb4ef292bac2f5f76ec380/users/5fcb2490b21b469db33c44849586c1c5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.113155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ba317876bb4ef292bac2f5f76ec380, user_id=5fcb2490b21b469db33c44849586c1c5, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.115853 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac04886-b3cf-4c7c-a10e-8580d6914058 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.116283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:03.129324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:03.130563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.131874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1318/2631] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:03 2022] PUT /identity/v3/projects/a2ba317876bb4ef292bac2f5f76ec380/users/5fcb2490b21b469db33c44849586c1c5/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:03.144495 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602126-aa33-47aa-a454-e561757b402c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.145506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602126-aa33-47aa-a454-e561757b402c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.145506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602126-aa33-47aa-a454-e561757b402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.179551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d602126-aa33-47aa-a454-e561757b402c None None] MFA Rules not processed for user `5fcb2490b21b469db33c44849586c1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:03.180807 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d602126-aa33-47aa-a454-e561757b402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.211917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1314/2632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:03.216645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.228061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484523b4-1ed2-4907-b7ea-7fc6409a2754 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.234269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.234897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.235192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.235477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.236140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:03.236440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.238175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.257125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1315/2633] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:03.258209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.260392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1319/2634] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:03.269901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e27f-10ef-4ce4-84d7-02ed2dd87ae7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.274081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602126-aa33-47aa-a454-e561757b402c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.275247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.277604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d602126-aa33-47aa-a454-e561757b402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.277786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.277786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.277786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.277786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.278972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.353785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602126-aa33-47aa-a454-e561757b402c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.357500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.358441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.358722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.358997 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.369174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.375945 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.384603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1320/2635] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:03.409786 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1316/2636] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:03.411635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.424590 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8bf4f-946c-471e-95af-e2ee6f47c8fa service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.433658 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:03.490478 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.491163 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.491382 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.491659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.492276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.494177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.611072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1321/2637] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:03.615227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.628883 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8643f1-43c0-41f2-9824-6d41809e4b4c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.634993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.635522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.636093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.636574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.637747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.640863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.662905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1317/2638] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:03.664049 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.675249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d46758-d6c4-4ab7-a075-87acc071a254 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.680385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.680999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.683861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.683861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.683861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.684183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff85a8-858c-4746-8dec-29db2c3526bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.695549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1322/2639] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:03.699970 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:03.710808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff1d2-19e9-4e4f-9e4f-3d70d813f529 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:03.715934 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:03.717014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.717014 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.717278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] PATH_INFO: `/v3/projects/a1ce5c9ed6aa4f5c86f23dfad18e7e48/users/98d21a0cc3604f198be32845d4b6f73d/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.733719 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ce5c9ed6aa4f5c86f23dfad18e7e48, user_id=98d21a0cc3604f198be32845d4b6f73d, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:03.736275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:03.860009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1318/2640] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:03 2022] PUT /identity/v3/projects/a1ce5c9ed6aa4f5c86f23dfad18e7e48/users/98d21a0cc3604f198be32845d4b6f73d/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:03.870548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:03.870924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:03.871471 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:03.913193 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] MFA Rules not processed for user `98d21a0cc3604f198be32845d4b6f73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:03.914483 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:03.996490 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1323/2641] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:04.135273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:04.198490 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42236d-71ac-4da1-8689-92c7d9c07d85 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:04.202523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:04.203191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:04.203474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:04.203747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:04.213279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:04.214829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:04.225486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1319/2642] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:04.849103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:04.854690 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:04.863158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675259-7cef-4bd9-ba6a-b03bf5b8fcca None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:04.866935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:04.867555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:04.867836 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:04.868108 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:04.869842 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:04.933843 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:04.935342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f370a-4716-4b6e-8fc6-a75538b850ac service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:04.945966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1324/2643] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:05.736144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:05.740807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:05.791055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:05.824358 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918050c-b2d6-4bcc-a231-7ed82f1bb9c9 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:05.829722 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:05.830484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:05.830765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:05.831043 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] PATH_INFO: `/v3/users/66ed946148bb456a9cdf78dde8e7071f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:05.832323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ed946148bb456a9cdf78dde8e7071f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:05.834319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:06.141913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ed946148bb456a9cdf78dde8e7071f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:06.142693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ed946148bb456a9cdf78dde8e7071f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:06.143329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ed946148bb456a9cdf78dde8e7071f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:06.150301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ed946148bb456a9cdf78dde8e7071f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:06.162481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ed946148bb456a9cdf78dde8e7071f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:06.256683 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1320/2644] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:05 2022] DELETE /identity/v3/users/66ed946148bb456a9cdf78dde8e7071f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:06.261994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:06.262506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:06.262606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:06.282758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:06.284005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:06.297396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:06.345435 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1325/2645] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:06.355819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:06.357426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:06.419376 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fbd50-781f-4561-b66b-3affd88975f8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:06.424055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:06.424698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:06.424974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:06.425255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:06.435307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:06.437196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0595-6211-4e88-84e2-c20d4ffb745c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:06.448124 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1321/2646] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:07.333368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:07.336662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:07.356686 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf196c5-3832-4457-93fe-83e4603cd47a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:07.364940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:07.366107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:07.366699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:07.367333 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] PATH_INFO: `/v3/projects/7ccd204b1cb843c2b3f0776bf3337345` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:07.369514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccd204b1cb843c2b3f0776bf3337345)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:07.381414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:07.503289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccd204b1cb843c2b3f0776bf3337345', 'request_id': 'req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:07.515322 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccd204b1cb843c2b3f0776bf3337345', 'request_id': 'req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:07.526617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccd204b1cb843c2b3f0776bf3337345', 'request_id': 'req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:07.704550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] The token cache is being invalidate because project 7ccd204b1cb843c2b3f0776bf3337345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:07.704879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:07.705515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfe10c2d-4f81-4e28-9115-d8bedacd48d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:07.707092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1326/2647] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:07 2022] DELETE /identity/v3/projects/7ccd204b1cb843c2b3f0776bf3337345 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:07.712808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:07.713388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:07.713388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:07.735964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:07.737207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:07.809253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:07.819806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1322/2648] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:07.828985 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:07.829368 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:07.829650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:07.851261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:07.852499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:07.861125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1327/2649] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:07.866960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:07.880670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46962f34-b858-429d-ad03-4ea9ce652be4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:07.886950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:07.893581 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:07.905148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1323/2650] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:07.911254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:07.922133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049e49-c7e6-4ad0-93cd-36846791c366 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:07.927198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:07.927820 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:07.928138 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:07.928407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:07.929043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:07.930980 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.134756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1328/2651] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:07 2022] POST /identity/v3/projects => generated 397 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:08.139656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:08.149912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36022-605e-4003-b035-d2fedbc8b8dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:08.215167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:08.215916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.216038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.216293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.218179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:08.220140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.300420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1324/2652] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:08 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:08.304595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:08.315786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5f12-d501-4ae9-af5d-7698319c67d1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:08.320642 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:08.325767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.325767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.325767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.325767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:08.325767 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.336492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1329/2653] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:08.341050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:08.362089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aa61-d5ce-459e-9d11-d292a92cb09a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:08.367353 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:08.370849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.370849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.370849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.370849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:08.370849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e201b-9231-4594-89d0-1637f57b758c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.382471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1325/2654] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:08.387147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:08.402016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958813fc-d986-4b96-a668-4bd8a04bce95 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:08.404852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:08.405549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.405825 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.406096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] PATH_INFO: `/v3/projects/3e3ed44bf56b47999f8e444cc01810fa/users/3bfb0ab2bacc4a07b63c761b6eb69d01/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.424445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3ed44bf56b47999f8e444cc01810fa, user_id=3bfb0ab2bacc4a07b63c761b6eb69d01, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:08.427241 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.511895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1330/2655] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:08 2022] PUT /identity/v3/projects/3e3ed44bf56b47999f8e444cc01810fa/users/3bfb0ab2bacc4a07b63c761b6eb69d01/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:08.522803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.523003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.523321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.555700 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] MFA Rules not processed for user `3bfb0ab2bacc4a07b63c761b6eb69d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:08.556991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:08.650566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1326/2656] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:08.665634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:08.667515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:08.711845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:08.738245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d71-3fc8-4497-bd6c-8be751a0cc64 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:08.743915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:08.744881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:08.745347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:08.745789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:08.758921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:08.760425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:08.770553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1331/2657] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:10.479819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:10.481452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:10.496048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d545-1735-49c4-a399-a5ee11675734 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:10.501362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:10.502067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:10.502388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:10.502705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:10.504730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:10.564711 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:10.582015 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:10.584558 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b74c63-c2af-415e-9193-acc535c20fe9 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:10.601573 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1327/2658] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:15.580709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:15.582386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:15.684970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123778-d3c3-42fa-baa2-262420028f64 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:15.692576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:15.693565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:15.693987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:15.694489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] PATH_INFO: `/v3/users/d6a59346f969467e94c63c45cfc525ed` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:15.696549 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a59346f969467e94c63c45cfc525ed)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:15.699950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:15.946135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a59346f969467e94c63c45cfc525ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:15.946886 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a59346f969467e94c63c45cfc525ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:15.947554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a59346f969467e94c63c45cfc525ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:15.957491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a59346f969467e94c63c45cfc525ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.055099 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a59346f969467e94c63c45cfc525ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.076983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1332/2659] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:15 2022] DELETE /identity/v3/users/d6a59346f969467e94c63c45cfc525ed => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:16.081941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:16.086641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:16.086641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:16.104054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:16.105307 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:16.177370 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1328/2660] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:16.188265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:16.189757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:16.259073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53052-c160-4674-9fd3-a6111b153a7f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:16.264780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:16.265202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:16.265697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:16.266190 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:16.278847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:16.281173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:16.292832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1333/2661] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:16.402727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:16.405287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:16.419348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457cf90-09cb-434e-80e9-5eefe41b2c19 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:16.425624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:16.431698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:16.431698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:16.431698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] PATH_INFO: `/v3/users/3bfb0ab2bacc4a07b63c761b6eb69d01` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:16.431698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfb0ab2bacc4a07b63c761b6eb69d01)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:16.431698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:16.806799 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfb0ab2bacc4a07b63c761b6eb69d01'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.808119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfb0ab2bacc4a07b63c761b6eb69d01'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.808993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfb0ab2bacc4a07b63c761b6eb69d01'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.816172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:16.817974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:16.818212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfb0ab2bacc4a07b63c761b6eb69d01'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.827893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:16.831880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfb0ab2bacc4a07b63c761b6eb69d01'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:16.834467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5bae6-4ab1-414b-abf7-03def9cb2dc8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:16.840405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:16.841133 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:16.842164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:16.842496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] PATH_INFO: `/v3/users/98d21a0cc3604f198be32845d4b6f73d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:16.844141 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d21a0cc3604f198be32845d4b6f73d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:16.846768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:17.025941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1329/2662] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:16 2022] DELETE /identity/v3/users/3bfb0ab2bacc4a07b63c761b6eb69d01 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:17.027005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:17.028602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.100256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39035-40cd-47f9-b594-18d5817211da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:17.105053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:17.105697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.105978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.106249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] PATH_INFO: `/v3/projects/e794e8ddc4e4424d8adbd2aec20a0f2c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.108109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e794e8ddc4e4424d8adbd2aec20a0f2c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:17.110103 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:17.117081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:17.147073 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d21a0cc3604f198be32845d4b6f73d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.148348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d21a0cc3604f198be32845d4b6f73d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.148966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d21a0cc3604f198be32845d4b6f73d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.157517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d21a0cc3604f198be32845d4b6f73d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.243282 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e794e8ddc4e4424d8adbd2aec20a0f2c', 'request_id': 'req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.246312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5bce0b-de39-4d3d-b15b-405d20e5ecf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d21a0cc3604f198be32845d4b6f73d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.251192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e794e8ddc4e4424d8adbd2aec20a0f2c', 'request_id': 'req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.268648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1334/2663] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:16 2022] DELETE /identity/v3/users/98d21a0cc3604f198be32845d4b6f73d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:17.269935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8498-e51e-4605-8ac7-4d1c71f05544 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.270228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8498-e51e-4605-8ac7-4d1c71f05544 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.270528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8498-e51e-4605-8ac7-4d1c71f05544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.290534 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e78a8498-e51e-4605-8ac7-4d1c71f05544 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:17.291841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e78a8498-e51e-4605-8ac7-4d1c71f05544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.354659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e794e8ddc4e4424d8adbd2aec20a0f2c', 'request_id': 'req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.368586 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] The token cache is being invalidate because project e794e8ddc4e4424d8adbd2aec20a0f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:17.368882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.369543 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.369907 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1335/2664] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:17.375790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1330/2665] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:17 2022] DELETE /identity/v3/projects/e794e8ddc4e4424d8adbd2aec20a0f2c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:17.376840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.376840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.376840 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.377355 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:17.378994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.403197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:17.405703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.418408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1336/2666] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:17.419718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:17.424392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.475211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03155-ec46-41fc-91c9-9e1dbc6eda16 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:17.480580 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:17.481267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.482231 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.482674 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] PATH_INFO: `/v3/users/64e1ba38a55f43d782a715156c3fd773` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.484234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e1ba38a55f43d782a715156c3fd773)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:17.486210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:17.497025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb2bc-0f43-48d2-ae0e-c0dedc0fff52 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:17.502942 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:17.504143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.504348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.504619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.507137 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.522514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:17.524198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:17.536128 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1337/2667] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:17.537920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:17.540302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:17.560660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a9a5-c97b-40b0-bc02-2809158f6834 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:17.567360 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:17.570904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:17.570904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:17.570904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:17.586934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:17.589904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:17.603851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:17.608014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1338/2668] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:17.730411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e1ba38a55f43d782a715156c3fd773'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.731479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e1ba38a55f43d782a715156c3fd773'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.732847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e1ba38a55f43d782a715156c3fd773'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.741939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e1ba38a55f43d782a715156c3fd773'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.757699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e1ba38a55f43d782a715156c3fd773'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:17.850335 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1331/2669] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:17 2022] DELETE /identity/v3/users/64e1ba38a55f43d782a715156c3fd773 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:18.108537 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:18.112977 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:18.140034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333bcfa-4370-4619-8cfa-f8886552f799 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:18.256809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:18.256809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.256809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.256809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] PATH_INFO: `/v3/projects/3e3ed44bf56b47999f8e444cc01810fa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.257342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3ed44bf56b47999f8e444cc01810fa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:18.257342 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:18.316075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:18.318848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:18.334136 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a0911-229c-4b96-b85c-77c930d080c4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:18.338876 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:18.339561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.339844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.340119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] PATH_INFO: `/v3/projects/a1ce5c9ed6aa4f5c86f23dfad18e7e48` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.341280 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ce5c9ed6aa4f5c86f23dfad18e7e48)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:18.343379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:18.352305 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:18.425584 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3ed44bf56b47999f8e444cc01810fa', 'request_id': 'req-de49494a-0ec2-42e4-b12b-8cc5dd15255b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.431165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3ed44bf56b47999f8e444cc01810fa', 'request_id': 'req-de49494a-0ec2-42e4-b12b-8cc5dd15255b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.437993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3ed44bf56b47999f8e444cc01810fa', 'request_id': 'req-de49494a-0ec2-42e4-b12b-8cc5dd15255b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.489279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ce5c9ed6aa4f5c86f23dfad18e7e48', 'request_id': 'req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.495296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ce5c9ed6aa4f5c86f23dfad18e7e48', 'request_id': 'req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.578319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] The token cache is being invalidate because project 3e3ed44bf56b47999f8e444cc01810fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:18.578619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.579291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.580790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1339/2670] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:18 2022] DELETE /identity/v3/projects/3e3ed44bf56b47999f8e444cc01810fa => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:18.590695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:18.590695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:18.663176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49494a-0ec2-42e4-b12b-8cc5dd15255b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:18.666277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ce5c9ed6aa4f5c86f23dfad18e7e48', 'request_id': 'req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.680917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] The token cache is being invalidate because project a1ce5c9ed6aa4f5c86f23dfad18e7e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:18.681209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.681904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68f16b11-2816-4aa6-b4bb-2adcbd7233f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.683508 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1332/2671] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:18 2022] DELETE /identity/v3/projects/a1ce5c9ed6aa4f5c86f23dfad18e7e48 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:18.689343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc03a-0a07-4372-9662-1fce32878e56 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.689728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc03a-0a07-4372-9662-1fce32878e56 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.690069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc03a-0a07-4372-9662-1fce32878e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.709747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:18.713555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7f8dc03a-0a07-4372-9662-1fce32878e56 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:18.719264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f8dc03a-0a07-4372-9662-1fce32878e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:18.748458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:18.748458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.748458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.748458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] PATH_INFO: `/v3/projects/c07979e4fc5e4d1aa57daff88aab4ff2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.748990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07979e4fc5e4d1aa57daff88aab4ff2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:18.748990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:18.790936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1333/2672] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:18.799437 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.799736 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.800291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.821418 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:18.822680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:18.832038 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1334/2673] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:18.837065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:18.847310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162fc4-8e6e-43eb-b6f9-90233fb2a9fd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:18.853168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:18.853797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.854073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.854346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.855006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:18.855597 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:18.857500 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:18.870007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1335/2674] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:18.874421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07979e4fc5e4d1aa57daff88aab4ff2', 'request_id': 'req-3c139cdc-427c-4f4d-97e1-73e8469063f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.875308 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:18.879913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07979e4fc5e4d1aa57daff88aab4ff2', 'request_id': 'req-3c139cdc-427c-4f4d-97e1-73e8469063f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.886692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07979e4fc5e4d1aa57daff88aab4ff2', 'request_id': 'req-3c139cdc-427c-4f4d-97e1-73e8469063f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:18.887401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e233ba-eea3-4a7b-ac19-86b102aeed75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:18.946929 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:18.947575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:18.947859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:18.948142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:18.948775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:18.951561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.008962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] The token cache is being invalidate because project c07979e4fc5e4d1aa57daff88aab4ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:19.009211 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.009821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.011367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1340/2675] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:18 2022] DELETE /identity/v3/projects/c07979e4fc5e4d1aa57daff88aab4ff2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:19.016559 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.018167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.032606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139cdc-427c-4f4d-97e1-73e8469063f3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.038798 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.039931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.040427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.040923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] PATH_INFO: `/v3/users/5fcb2490b21b469db33c44849586c1c5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.043475 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcb2490b21b469db33c44849586c1c5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.047600 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.051863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1336/2676] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:18 2022] POST /identity/v3/projects => generated 403 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:19.053162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.055022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.126147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3b19-5f87-491a-a398-f710b4a23fbd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.130942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.131572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.131855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.132125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.132763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.134801 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.264134 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1337/2677] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:19 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:19.268195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.274414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcb2490b21b469db33c44849586c1c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.275070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcb2490b21b469db33c44849586c1c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.275701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcb2490b21b469db33c44849586c1c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.277728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3c448-cf05-4f28-a9a7-f2237022d06d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.282981 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.283573 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcb2490b21b469db33c44849586c1c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.283699 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.283877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.284149 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.284935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.286487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.299120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1338/2678] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:19.302967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.304817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.317659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdd6f5-0827-48c2-b763-d82fbf117d8c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.322507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.323140 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.323423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.323703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.324357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.325991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.335245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1d834506-8380-429b-9ede-6d53e89b6c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcb2490b21b469db33c44849586c1c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:19.339239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1339/2679] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:19.342010 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.352387 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81bbe0-f115-46dd-a2b6-bd78f4fd11ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.355118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1341/2680] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:19 2022] DELETE /identity/v3/users/5fcb2490b21b469db33c44849586c1c5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:19.357849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.359054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.359695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.359806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] PATH_INFO: `/v3/projects/6b87bd062f6e4d85a1528235c46ea730/users/7ad84e2e23044ec79c7a99be4c5c4223/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.375380 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b87bd062f6e4d85a1528235c46ea730, user_id=7ad84e2e23044ec79c7a99be4c5c4223, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.378037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.450485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1340/2681] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:19 2022] PUT /identity/v3/projects/6b87bd062f6e4d85a1528235c46ea730/users/7ad84e2e23044ec79c7a99be4c5c4223/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:19.456464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.456751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.457053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.476968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:19.478160 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.553957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1342/2682] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:19.564853 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.567041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.636064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0261-babd-4d80-afe7-8b6664eaf7e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.640111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.640726 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.641007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.641289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.648924 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:19.652830 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.655863 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2734aa9-0707-4e8c-b80d-ed5c8a767f8d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:19.665122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1341/2683] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:19.674936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:19.865164 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:19.866648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:19.879519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f3983-fb0d-4386-939c-91cf47ee2424 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:19.884809 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:19.885453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:19.885736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:19.886004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] PATH_INFO: `/v3/projects/a2ba317876bb4ef292bac2f5f76ec380` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:19.887191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ba317876bb4ef292bac2f5f76ec380)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:19.890390 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.011320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ba317876bb4ef292bac2f5f76ec380', 'request_id': 'req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:20.018225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ba317876bb4ef292bac2f5f76ec380', 'request_id': 'req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:20.024575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ba317876bb4ef292bac2f5f76ec380', 'request_id': 'req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:20.115151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] The token cache is being invalidate because project a2ba317876bb4ef292bac2f5f76ec380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:20.115529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:20.120090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66ab5cd2-f252-4821-99e7-e76bdb0c10c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:20.120090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1343/2684] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:19 2022] DELETE /identity/v3/projects/a2ba317876bb4ef292bac2f5f76ec380 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:20.125291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.125788 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.126276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.151715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:20.153357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:20.211907 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:20.228779 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1342/2685] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:20.241765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.241765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.241765 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.262586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:20.264696 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:20.273492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1344/2686] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:20.278163 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.288680 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b661-bfbb-4f1b-a926-6b9f3b81d452 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.293553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.294179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.295148 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.296034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.296142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:20.296385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.298017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.313443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1343/2687] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:55:20.317905 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.330254 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568f31-3334-4380-9eda-801fb4fc9fa2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.338556 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.339760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.340266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.340771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.342335 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.346506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.451601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1345/2688] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:20 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:20.456720 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.468436 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b077-66a2-46a0-aba0-c0a677ccd317 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.541194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.541829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.542105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.542381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.543041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.545792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.693608 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1344/2689] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:20 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:20.697994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.710929 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78114cf-8a91-4bcb-86b9-5c782b65ebfb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.717529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.718165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.718592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.718878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.719580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.721231 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.739397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1346/2690] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:20.742537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.755326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c168ba-aa06-4be9-bdef-7221d79942b2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.760559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.761203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.761485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.761761 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.762423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.764797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997455-a890-45c3-90a2-cceecedfa21e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:20.777454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1345/2691] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:20.783121 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:20.797613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444135c-8148-44bb-a00a-0ea8d0e51c92 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:20.803442 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:20.804147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:20.804420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:20.804688 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] PATH_INFO: `/v3/projects/73474bfee2a745549e189adc758dedb1/users/31f68046a55b4f57b5c10e8fb86f205a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:20.824176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73474bfee2a745549e189adc758dedb1, user_id=31f68046a55b4f57b5c10e8fb86f205a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:20.830271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.035826 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1347/2692] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:20 2022] PUT /identity/v3/projects/73474bfee2a745549e189adc758dedb1/users/31f68046a55b4f57b5c10e8fb86f205a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:21.050614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.050903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.051251 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.096118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] MFA Rules not processed for user `31f68046a55b4f57b5c10e8fb86f205a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:21.097681 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:21.182753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1346/2693] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:21.188317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.254540 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:21.258348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d50da-1323-4c9e-aa8d-ba145c49eff9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.263468 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.264124 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.264400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.264672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.265309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.267300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3ffc6-7911-4152-802d-60b921b6d030 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.402595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1348/2694] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:21.407689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.432805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.433424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.434079 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.434575 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c917f6-6d63-427d-a396-e0f959705fee None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.476157 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] MFA Rules not processed for user `7ad84e2e23044ec79c7a99be4c5c4223`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:21.477551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:21.501694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:21.526893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.526893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.537277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.537277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.537277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.537277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.591007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1349/2695] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:21.597109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.599602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:21.624566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5b6a-6ec6-4c16-92d5-4a09f4b56400 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.632614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.633703 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.634223 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.634718 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.635930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.640369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.651135 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1347/2696] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:21.657653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.676775 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7180-2045-446f-9c61-51c560dbae9a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.684803 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.685875 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.686393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.686904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.688138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.691233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.712852 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1348/2697] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:21.717840 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.728013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191c958-3fd8-4ce2-ac51-c022d367b9b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.732977 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.733647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.733949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.734209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] PATH_INFO: `/v3/projects/eec2647daeab46dc963bb5b9a67b73c4/users/b83bcee4ccec4211a4c635a2c6890b6b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.750066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec2647daeab46dc963bb5b9a67b73c4, user_id=b83bcee4ccec4211a4c635a2c6890b6b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.752787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.764950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1350/2698] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:21.769321 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.830725 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1349/2699] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:21 2022] PUT /identity/v3/projects/eec2647daeab46dc963bb5b9a67b73c4/users/b83bcee4ccec4211a4c635a2c6890b6b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:21.834054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b70e1-86b7-448d-b1ad-b963066d9cec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.834888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.892627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:21.898789 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.899532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.899884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.900155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.900776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.902704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.912050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef0d2-75db-4b37-bc46-b0a9865c4e0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.917771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.918400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.918676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.918952 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.919667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.921330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.932373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1350/2700] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:21.937300 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:21.947593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e0ef-f17c-4753-a5e1-a43e6039dd82 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:21.952987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:21.953640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.955684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.955684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] PATH_INFO: `/v3/projects/eec2647daeab46dc963bb5b9a67b73c4/users/b83bcee4ccec4211a4c635a2c6890b6b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:21.956242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec2647daeab46dc963bb5b9a67b73c4, user_id=b83bcee4ccec4211a4c635a2c6890b6b, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:21.958882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3f90-f594-4272-ac5d-48068db1f849 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:21.976849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1351/2701] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:21 2022] PUT /identity/v3/projects/eec2647daeab46dc963bb5b9a67b73c4/users/b83bcee4ccec4211a4c635a2c6890b6b/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:21.981489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:21.988377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:21.988377 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.011526 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] MFA Rules not processed for user `b83bcee4ccec4211a4c635a2c6890b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:22.012196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1351/2702] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:22.012950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:22.017347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.029224 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648f90-dfcf-4902-8d4f-1d69a7c2433f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.092904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1352/2703] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:22.104810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.105436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.105721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.106051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.106612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.106743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.108180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:22.108699 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.118213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:22.119780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1352/2704] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:22.124919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.135913 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec0a1-6b1f-4bb5-89ea-99fd6e5e9d26 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.141516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.142586 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.142946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.143265 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] PATH_INFO: `/v3/projects/4050b80b61f54a878911033951602b52/users/7cb0c66f9d1946c9b17f96bff1ef18af/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.160421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4050b80b61f54a878911033951602b52, user_id=7cb0c66f9d1946c9b17f96bff1ef18af, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.163653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.172703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c74c-e9c1-4047-8e8e-8b1a09c7fe56 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.176562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.177438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.178007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.178132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.189619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.191075 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.202433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1353/2705] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:22.248408 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1353/2706] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:22 2022] PUT /identity/v3/projects/4050b80b61f54a878911033951602b52/users/7cb0c66f9d1946c9b17f96bff1ef18af/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:22.252759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.260852 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.262799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:22.266275 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a150-ba01-4810-9f88-f0ea6283bb22 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.329207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52031c-dde1-4e60-add4-2a56e32e3e01 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.333107 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.333727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.334010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.334304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.340858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.341668 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.341908 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.342188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.342849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.344520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.356340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1354/2707] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:22.361078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:22.372023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbad0-dec2-4491-83a0-7cf8c71b96f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:22.379182 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:22.380026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:22.380366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:22.380701 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] PATH_INFO: `/v3/projects/4050b80b61f54a878911033951602b52/users/7cb0c66f9d1946c9b17f96bff1ef18af/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:22.382829 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4050b80b61f54a878911033951602b52, user_id=7cb0c66f9d1946c9b17f96bff1ef18af, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.385546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d115920-98c1-4b5f-982a-43aca0f21336 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.397113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1355/2708] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:22 2022] PUT /identity/v3/projects/4050b80b61f54a878911033951602b52/users/7cb0c66f9d1946c9b17f96bff1ef18af/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:22.405058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:22.406606 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:22.417082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1354/2709] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:23.850656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:23.851390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:23.851390 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:23.883614 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] MFA Rules not processed for user `7cb0c66f9d1946c9b17f96bff1ef18af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:23.884972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:23.963175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1356/2710] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:25.539569 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:25.553395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd66f-9b8c-4b7e-bac6-628336a0d589 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:25.564206 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:25.630591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:25.631277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:25.631555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:25.631828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] PATH_INFO: `/v3/users/7ad84e2e23044ec79c7a99be4c5c4223` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:25.633126 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad84e2e23044ec79c7a99be4c5c4223)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:25.635179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:25.958283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad84e2e23044ec79c7a99be4c5c4223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:25.958937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad84e2e23044ec79c7a99be4c5c4223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:25.959587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad84e2e23044ec79c7a99be4c5c4223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:25.966591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad84e2e23044ec79c7a99be4c5c4223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.172174 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad84e2e23044ec79c7a99be4c5c4223'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.194183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1355/2711] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:25 2022] DELETE /identity/v3/users/7ad84e2e23044ec79c7a99be4c5c4223 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:26.567774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:26.590941 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802d737-863f-4c5e-b9c3-b3de3cabc58f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:26.600940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:26.651655 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:26.652289 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:26.652566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:26.652847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] PATH_INFO: `/v3/projects/6b87bd062f6e4d85a1528235c46ea730` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:26.654116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b87bd062f6e4d85a1528235c46ea730)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:26.656193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:26.771488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b87bd062f6e4d85a1528235c46ea730', 'request_id': 'req-95365b81-cfa1-499a-9588-f0da86cf8ff4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.778184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b87bd062f6e4d85a1528235c46ea730', 'request_id': 'req-95365b81-cfa1-499a-9588-f0da86cf8ff4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.886263 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b87bd062f6e4d85a1528235c46ea730', 'request_id': 'req-95365b81-cfa1-499a-9588-f0da86cf8ff4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.904527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] The token cache is being invalidate because project 6b87bd062f6e4d85a1528235c46ea730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:26.904868 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.905888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:26.908612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1357/2712] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:26 2022] DELETE /identity/v3/projects/6b87bd062f6e4d85a1528235c46ea730 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:26.914651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:26.916800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:26.942153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e71e8-3790-46bc-8848-fa97165fef59 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:27.010493 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:27.011179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:27.011467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:27.011736 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] PATH_INFO: `/v3/users/7cb0c66f9d1946c9b17f96bff1ef18af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:27.012987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb0c66f9d1946c9b17f96bff1ef18af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:27.015444 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:27.200808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:27.212937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb0c66f9d1946c9b17f96bff1ef18af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.213757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb0c66f9d1946c9b17f96bff1ef18af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.214578 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb0c66f9d1946c9b17f96bff1ef18af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.224118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb0c66f9d1946c9b17f96bff1ef18af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.314947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb0c66f9d1946c9b17f96bff1ef18af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.335959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1356/2713] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:26 2022] DELETE /identity/v3/users/7cb0c66f9d1946c9b17f96bff1ef18af => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:27.643157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:27.644131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:27.663416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365b81-cfa1-499a-9588-f0da86cf8ff4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:27.735477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:27.736137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:27.736421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:27.736693 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] PATH_INFO: `/v3/projects/4050b80b61f54a878911033951602b52` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:27.738061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4050b80b61f54a878911033951602b52)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:27.740174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:27.808071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:27.809596 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:27.832370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bd227-a8b0-421c-8982-33449038a097 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:27.839841 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:27.840510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:27.840816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:27.841727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] PATH_INFO: `/v3/users/31f68046a55b4f57b5c10e8fb86f205a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:27.843191 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f68046a55b4f57b5c10e8fb86f205a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:27.845155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:27.857340 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4050b80b61f54a878911033951602b52', 'request_id': 'req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.858849 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:27.866447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4050b80b61f54a878911033951602b52', 'request_id': 'req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.955627 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4050b80b61f54a878911033951602b52', 'request_id': 'req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.973731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] The token cache is being invalidate because project 4050b80b61f54a878911033951602b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:27.974212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.975155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d24a59d1-0b48-4919-b6ed-9ef6edb7dfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:27.977235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1358/2714] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:27 2022] DELETE /identity/v3/projects/4050b80b61f54a878911033951602b52 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:27.984704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebea0f-5a4d-407e-8026-c1b938ac3cb7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:27.985411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebea0f-5a4d-407e-8026-c1b938ac3cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:27.986213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebea0f-5a4d-407e-8026-c1b938ac3cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.020022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2ebea0f-5a4d-407e-8026-c1b938ac3cb7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:28.022267 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2ebea0f-5a4d-407e-8026-c1b938ac3cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:28.098566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1359/2715] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:28.103110 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f68046a55b4f57b5c10e8fb86f205a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:28.103965 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f68046a55b4f57b5c10e8fb86f205a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:28.104571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f68046a55b4f57b5c10e8fb86f205a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:28.111912 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.112203 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.112487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.114623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f68046a55b4f57b5c10e8fb86f205a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:28.144462 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:28.146903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:28.161017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1360/2716] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:28.168078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.181426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7757dd-07b2-4c33-93b2-2603a71990a6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.187479 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.188210 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.188493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.188765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.189428 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:28.189735 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.191425 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.199794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a8418bb-f738-47fe-862a-f620ac262f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f68046a55b4f57b5c10e8fb86f205a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:28.205540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1361/2717] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:55:28.209767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.220295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19734872-793d-4f68-bb7f-165892fc1db2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.225564 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.226196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.226475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.231572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.231572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.231572 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.234948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1357/2718] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:27 2022] DELETE /identity/v3/users/31f68046a55b4f57b5c10e8fb86f205a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:28.240710 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.241251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.241722 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.276434 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:28.277938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:28.324357 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1362/2719] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:28.325966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.358410 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1358/2720] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:28.370576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.372924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:28.409035 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:28.418584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408fa04-7133-4918-9941-892deeb1317a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.424532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.425208 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.425489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.425763 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.426426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.428594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.448601 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7282ac-263c-4c26-9909-209eb190aea1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.504691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.505316 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.505701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.506205 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.517971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1363/2721] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:28.519623 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.524502 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.527054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.538158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed65da-03dc-473e-a71e-89206210db06 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.545700 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1359/2722] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:28.546628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.548069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.548069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.548411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.549074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.550922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.567216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1364/2723] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:28.569349 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.585119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f346889-2e4d-47d5-bdbd-ab4525eddce3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.593125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.594370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.594370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.594370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.595822 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.596782 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f1c6-5188-4566-9bf6-3cb416092632 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.611261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1360/2724] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:28.613102 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:28.624298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972774-3743-488b-bbc2-9ba2483830be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:28.629458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:28.630152 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.630450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.630727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] PATH_INFO: `/v3/projects/040839342b484dd28c0b9e7fc248b56e/users/d756846bf9fd408fa2363e046c816f8a/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.648017 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:28.654276 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=040839342b484dd28c0b9e7fc248b56e, user_id=d756846bf9fd408fa2363e046c816f8a, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:28.659617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:28.867703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1365/2725] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:28 2022] PUT /identity/v3/projects/040839342b484dd28c0b9e7fc248b56e/users/d756846bf9fd408fa2363e046c816f8a/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:28.878638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:28.878904 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:28.879561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:28.916029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] MFA Rules not processed for user `d756846bf9fd408fa2363e046c816f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:28.917627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:28.989802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1361/2726] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:28.994689 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.059253 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d9e47-3a2f-47c9-b2f9-79415248b38b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.064698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.065304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.065576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.065847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.066497 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.068417 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.156431 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.157918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:29.174392 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef981e-72d3-46d6-9646-923860b995d5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.179786 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.180456 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.180702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.180957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] PATH_INFO: `/v3/projects/73474bfee2a745549e189adc758dedb1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.182242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73474bfee2a745549e189adc758dedb1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.189799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.190094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1366/2727] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:29.192213 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.261108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac66aed-6b65-4dd4-b695-ea0d0a301905 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.266734 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.267392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.267675 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.267950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.268587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.270544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.341278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73474bfee2a745549e189adc758dedb1', 'request_id': 'req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.346576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:29.351713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73474bfee2a745549e189adc758dedb1', 'request_id': 'req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.357753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1367/2728] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:29 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:29.361961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.362960 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73474bfee2a745549e189adc758dedb1', 'request_id': 'req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.373618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021f1f-62ee-473a-82c1-51912938b63e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.437113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.437647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.437930 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.438215 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.438922 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.440728 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.456542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1368/2729] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:29.457935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.464729 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:29.470155 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04682-4b3d-41ed-8f2e-2ccbcb4224f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.475288 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.476064 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.476246 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.476556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] PATH_INFO: `/v3/projects/0667faf872364b8fa266fdc880bf0a67/users/17b33d36c15a415ebd8f759ad455917a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.477785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] The token cache is being invalidate because project 73474bfee2a745549e189adc758dedb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:29.478086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.478760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.480315 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1362/2730] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:29 2022] DELETE /identity/v3/projects/73474bfee2a745549e189adc758dedb1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:29.485166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.486567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:29.494456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0667faf872364b8fa266fdc880bf0a67, user_id=17b33d36c15a415ebd8f759ad455917a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.497477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.501517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b0ebb-198d-4e7b-b8bf-377cdec93c0a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.507603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.507603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.507603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.507931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] PATH_INFO: `/v3/users/b83bcee4ccec4211a4c635a2c6890b6b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.508937 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83bcee4ccec4211a4c635a2c6890b6b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.510876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.589682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1369/2731] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:29 2022] PUT /identity/v3/projects/0667faf872364b8fa266fdc880bf0a67/users/17b33d36c15a415ebd8f759ad455917a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:29.594419 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.596143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:29.664494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ef6e-6e54-4085-8571-5f0baad8a1b2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.670992 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.671748 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.672032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.672304 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.673138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.674612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.685421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1370/2732] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:29.689841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.700619 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b599db-b20c-44a7-8b40-d74f0b25802f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.705513 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.706309 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.706624 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.706873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] PATH_INFO: `/v3/projects/0667faf872364b8fa266fdc880bf0a67/users/17b33d36c15a415ebd8f759ad455917a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.708971 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0667faf872364b8fa266fdc880bf0a67, user_id=17b33d36c15a415ebd8f759ad455917a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:29.711676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d283ce-1201-41bb-8afb-b71a4216dba7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:29.724129 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1371/2733] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:29 2022] PUT /identity/v3/projects/0667faf872364b8fa266fdc880bf0a67/users/17b33d36c15a415ebd8f759ad455917a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:29.741385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.741670 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.741945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:29.769409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83bcee4ccec4211a4c635a2c6890b6b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.770319 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83bcee4ccec4211a4c635a2c6890b6b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.771186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83bcee4ccec4211a4c635a2c6890b6b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.772023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] MFA Rules not processed for user `17b33d36c15a415ebd8f759ad455917a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:29.773250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:29.780370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83bcee4ccec4211a4c635a2c6890b6b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.845593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1372/2734] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:29.854918 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83bcee4ccec4211a4c635a2c6890b6b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:29.871723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:29.873516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:29.882441 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1363/2735] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:29 2022] DELETE /identity/v3/users/b83bcee4ccec4211a4c635a2c6890b6b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:29.936049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:29.941715 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857272b6-9eea-4148-bec7-4d44b890469b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:29.992917 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:29.993534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:29.993823 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:29.994094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.055749 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:30.057302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:30.068362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1373/2736] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:30.240576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:30.251000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595cfc4-bc79-4b51-a7af-06753b9f38e0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:30.254629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:30.255255 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.255536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.255816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.257541 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:30.302873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:30.304757 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:30.320794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:30.322284 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3ccbb-6b13-49aa-8b32-0b15bcb5390e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:30.332367 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1364/2737] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:30.380612 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c0016-5e35-4a02-8211-e0faa49ede1a service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:30.385337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:30.385966 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.386245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.386520 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] PATH_INFO: `/v3/projects/eec2647daeab46dc963bb5b9a67b73c4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.387721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec2647daeab46dc963bb5b9a67b73c4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:30.390241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:30.494811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec2647daeab46dc963bb5b9a67b73c4', 'request_id': 'req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:30.501821 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:30.506343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec2647daeab46dc963bb5b9a67b73c4', 'request_id': 'req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:30.603764 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec2647daeab46dc963bb5b9a67b73c4', 'request_id': 'req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:30.617412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] The token cache is being invalidate because project eec2647daeab46dc963bb5b9a67b73c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:30.617998 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:30.618975 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00183f15-d24d-4bdd-b7fd-42e6b8c3468f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:30.620913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1374/2738] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:30 2022] DELETE /identity/v3/projects/eec2647daeab46dc963bb5b9a67b73c4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:30.628179 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.628484 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.628756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.650832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:30.652109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:30.705526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:30.717497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1365/2739] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:30.725556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.726073 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.726176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.749610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:30.749610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:30.765647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1375/2740] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:30.775005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:30.781337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a565a7a-b0f3-48d3-bc81-6ca7023ce3f6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:30.786150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:30.787034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.787356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.787628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.788289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:30.788597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:30.790225 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:30.802832 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1366/2741] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:55:30.807466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:30.817765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb0a70-ba96-43e7-a023-173b19e4ab0a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:30.823016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:30.823632 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:30.823913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:30.824187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:30.825193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:30.827661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:30.969723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1376/2742] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:30 2022] POST /identity/v3/projects => generated 407 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:30.975788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:30.988251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e17db1-6648-4f77-9f96-2ceacee92867 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.062380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.063016 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.063334 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.063614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.064289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.066236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:31.178411 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1367/2743] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:30 2022] POST /identity/v3/users => generated 304 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:31.182855 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:31.193504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcaa46-fe0f-47da-bebf-466b82dc2f06 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.198095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.198806 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.199055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.199365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.200031 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.201770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:31.213008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1377/2744] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:31.218167 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:31.229153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34b2a-943d-40ee-bcc3-790ae9150154 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.235897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.236526 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.236805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.237109 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.237757 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.239546 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571153b-f3c3-454d-9d6a-0bfc6e941407 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:31.251627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1368/2745] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:31.256176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:31.266669 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147637-7699-41db-8b6a-ddfd034a54ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.271447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.272122 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.272403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.272673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] PATH_INFO: `/v3/projects/a1644c5544c8494cb8a019eceab4af07/users/3098e8d5882c4a14898bf358d00a2da5/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.292870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1644c5544c8494cb8a019eceab4af07, user_id=3098e8d5882c4a14898bf358d00a2da5, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.296374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:31.415562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1378/2746] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:31 2022] PUT /identity/v3/projects/a1644c5544c8494cb8a019eceab4af07/users/3098e8d5882c4a14898bf358d00a2da5/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:31.427201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.427516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.427893 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.457388 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] MFA Rules not processed for user `3098e8d5882c4a14898bf358d00a2da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:31.458685 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:31.546271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1369/2747] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:31.551493 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:31.634503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782420-0c50-450a-b4dd-e6921faa6a76 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.640404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.641226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.641633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.642034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.642755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.645957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:31.750517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1379/2748] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:31 2022] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:31.754924 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:31.767276 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7072-00f3-4fcb-b625-9dcaba03156d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:31.829752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:31.849855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:31.850491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:31.850873 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:31.852970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:31.852970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:31.853879 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.001358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1370/2749] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:31 2022] POST /identity/v3/users => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:32.003481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:32.017454 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32055f-9c64-4792-bd08-5a48a952c6d1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:32.023396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:32.024481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.024993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.025480 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.026666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:32.030455 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.052537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1380/2750] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:32.058212 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:32.076033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3985-4e1f-4897-9a9c-c598958cfc5d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:32.084055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:32.085236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.085755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.086277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] PATH_INFO: `/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c/users/376e723b4adc46e791d0489c3dc19416/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.115055 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6aba270c3f4b2e8798acab27a14b3c, user_id=376e723b4adc46e791d0489c3dc19416, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:32.120575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.256751 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1371/2751] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:32 2022] PUT /identity/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c/users/376e723b4adc46e791d0489c3dc19416/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:32.262504 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:32.281945 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0708-56be-41e1-b882-f7a5e9cc8359 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:32.351923 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:32.368978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:32.370049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.370552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.371051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.371862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:32.375268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb62bb7-229c-4924-b6b3-d1fc3791dda6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.387070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1381/2752] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:32.391812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:32.403043 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63162e-d164-4cbf-a5d9-6c055cf65671 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:32.408025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:32.408678 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.408983 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.409251 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] PATH_INFO: `/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c/users/376e723b4adc46e791d0489c3dc19416/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.411266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6aba270c3f4b2e8798acab27a14b3c, user_id=376e723b4adc46e791d0489c3dc19416, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:32.414273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.428403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1372/2753] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:32 2022] PUT /identity/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c/users/376e723b4adc46e791d0489c3dc19416/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:32.439776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.440227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.440528 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.478401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] MFA Rules not processed for user `376e723b4adc46e791d0489c3dc19416`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:32.479750 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:32.560540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1382/2754] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:32.568655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:32.577928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:32.679834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835affd5-b09c-4e7f-bec3-5ad6f03b92d7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:32.684064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:32.684930 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:32.685058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:32.685337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:32.703320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:32.703320 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:32.709044 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1373/2755] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:33.164235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:33.175123 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90f10-5fe9-4b51-9c76-959121a1806f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:33.178810 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:33.179471 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:33.179758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:33.180032 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:33.245791 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:33.248006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:33.257967 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1383/2756] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:33 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:35.783976 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:35.785833 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:35.852218 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1ce8-fd11-4415-a6ae-b1b554af8e5a service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:35.856103 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:35.857216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:35.857494 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:35.857761 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:35.859651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:35.869989 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:35.873084 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:35.881594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1374/2757] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:40.743956 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:40.745430 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:40.759694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfd2c7-232a-4c8f-8c58-145820cb3fd6 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:40.764639 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:40.765258 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:40.765519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:40.766164 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:40.767949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:40.778502 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:40.780229 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:40.789456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1384/2758] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:40.868727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:40.882754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9733c-fbb5-40ea-ae3d-fa2a06614688 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:40.895457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:40.895457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:40.895457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:40.895457 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:40.896011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:40.955901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:40.984982 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:40.986762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:41.000517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1375/2759] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:41.072359 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:41.073813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:41.152933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:41.160262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbeb4a-08a5-4ac3-aac6-d67bc7e16d17 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:41.166256 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:41.166464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:41.166616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:41.166891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:41.168904 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:41.181249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:41.182848 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3304af-f741-4b69-a7d7-04efb1caeb19 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:41.195141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1385/2760] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:42.040142 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:42.136763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2e9e3-15cd-4bfb-8f26-9aa3fa971d29 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:42.143970 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:42.144957 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:42.145430 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:42.146228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] PATH_INFO: `/v3/users/3098e8d5882c4a14898bf358d00a2da5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:42.152499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3098e8d5882c4a14898bf358d00a2da5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:42.154085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:42.368282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3098e8d5882c4a14898bf358d00a2da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:42.368912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3098e8d5882c4a14898bf358d00a2da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:42.369575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3098e8d5882c4a14898bf358d00a2da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:42.377946 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3098e8d5882c4a14898bf358d00a2da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:42.463189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3098e8d5882c4a14898bf358d00a2da5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:42.482884 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1376/2761] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:42 2022] DELETE /identity/v3/users/3098e8d5882c4a14898bf358d00a2da5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:42.487592 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:42.488131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:42.488240 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:42.509847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:42.511109 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:42.577620 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1386/2762] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:42.589288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:42.591543 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:42.658834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e8708-3bb0-4029-997f-e6bcaa86cce3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:42.664094 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:42.664727 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:42.665000 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:42.665275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:42.674677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:42.677235 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:42.678724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:42.689591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1377/2763] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:43.163012 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:43.164224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:43.176232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f921319-06ab-4553-8c34-6cf00320e25e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:43.199915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:43.201486 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:43.202933 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:43.203245 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] PATH_INFO: `/v3/projects/a1644c5544c8494cb8a019eceab4af07` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:43.205269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1644c5544c8494cb8a019eceab4af07)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:43.207277 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:43.345765 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1644c5544c8494cb8a019eceab4af07', 'request_id': 'req-b38aaa17-0117-4ca0-901d-241e09b17a6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.351298 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1644c5544c8494cb8a019eceab4af07', 'request_id': 'req-b38aaa17-0117-4ca0-901d-241e09b17a6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.452410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1644c5544c8494cb8a019eceab4af07', 'request_id': 'req-b38aaa17-0117-4ca0-901d-241e09b17a6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.464546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] The token cache is being invalidate because project a1644c5544c8494cb8a019eceab4af07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:43.464838 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.465485 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.470534 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1387/2764] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:43 2022] DELETE /identity/v3/projects/a1644c5544c8494cb8a019eceab4af07 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:43.471814 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:43.482514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d3eb-8690-4dee-9629-6b3c5df2666a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:43.540282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:43.540921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:43.541273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:43.541570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] PATH_INFO: `/v3/users/376e723b4adc46e791d0489c3dc19416` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:43.542766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=376e723b4adc46e791d0489c3dc19416)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:43.545412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:43.802061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376e723b4adc46e791d0489c3dc19416'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.803529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376e723b4adc46e791d0489c3dc19416'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.804298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376e723b4adc46e791d0489c3dc19416'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.814978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376e723b4adc46e791d0489c3dc19416'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.932196 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab720ee2-48d6-473b-b4c9-4544d9ab43dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376e723b4adc46e791d0489c3dc19416'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:43.953939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1378/2765] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:43 2022] DELETE /identity/v3/users/376e723b4adc46e791d0489c3dc19416 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:44.383093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:44.384546 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:44.399997 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa17-0117-4ca0-901d-241e09b17a6b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:44.475651 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:44.477576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:44.477576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:44.477576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] PATH_INFO: `/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:44.478475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6aba270c3f4b2e8798acab27a14b3c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:44.480489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:44.497463 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:44.604822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6aba270c3f4b2e8798acab27a14b3c', 'request_id': 'req-a01c0849-8131-4053-80fd-130610bf2dcb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:44.610441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6aba270c3f4b2e8798acab27a14b3c', 'request_id': 'req-a01c0849-8131-4053-80fd-130610bf2dcb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:44.683110 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6aba270c3f4b2e8798acab27a14b3c', 'request_id': 'req-a01c0849-8131-4053-80fd-130610bf2dcb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:44.696230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] The token cache is being invalidate because project 8e6aba270c3f4b2e8798acab27a14b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:44.696517 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:44.697190 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01c0849-8131-4053-80fd-130610bf2dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:44.698731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1388/2766] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:44 2022] DELETE /identity/v3/projects/8e6aba270c3f4b2e8798acab27a14b3c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:44.704420 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:44.704944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:44.705054 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:44.725286 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:44.726499 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:44.791372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1379/2767] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:44.799598 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:44.799884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:44.800160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:44.821067 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:44.822283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:44.831224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1389/2768] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:44.836238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:44.846292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf794d-4a5d-4b34-93cf-daa5fb423d2a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:44.850895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:44.851531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:44.851805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:44.852076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:44.852723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:44.853028 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:44.854632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:44.875046 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1380/2769] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:55:44.880968 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:44.891559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943259-0367-47f6-a5d0-00c1b1dc9712 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:44.896703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:44.898013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:44.898299 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:44.898574 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:44.899271 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:44.901224 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.011345 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1390/2770] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:44 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:45.018691 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.024085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:45.030451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbb31-d2c1-4329-9f4a-5fe436af954c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.108336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.112007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.112007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.112007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.112007 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.112486 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.219565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1381/2771] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:45 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:45.223905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.235537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f77a8-084d-4ce3-9f92-d051fefad572 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.240281 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.240905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.241184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.241618 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.242174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.244100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.257511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1391/2772] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:45.265026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.275755 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cadc4-2ddb-402e-a07c-da803cdbed6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.281036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.281651 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.281933 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.282207 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.282862 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.284513 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a66be-d7bd-42db-94e2-43b0fa0cf923 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.297154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1382/2773] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:45.301337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.314009 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedcd56-8ed7-4b5d-b6a1-2132c74d91d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.319070 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.319762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.320050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.320325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] PATH_INFO: `/v3/projects/8fb8eaa7053b4b579beedf30e565812c/users/dfc9e8d44a684cac8e26db9992f97537/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.339776 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb8eaa7053b4b579beedf30e565812c, user_id=dfc9e8d44a684cac8e26db9992f97537, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.342570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.412905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1392/2774] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:45 2022] PUT /identity/v3/projects/8fb8eaa7053b4b579beedf30e565812c/users/dfc9e8d44a684cac8e26db9992f97537/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:45.423385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.423679 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.423952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.459739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] MFA Rules not processed for user `dfc9e8d44a684cac8e26db9992f97537`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:45.461120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:45.553288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1383/2775] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:45.560559 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.647957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe78d8-f236-4bc2-8e25-f2aac7fee5f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.652950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.657465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.657465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.657465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.657465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.657465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.780040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1393/2776] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:45 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:45.784961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.798769 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f733d6-04a2-4472-a26c-a069edab03a0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:45.875768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:45.876402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:45.876681 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:45.876952 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:45.877594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:45.880001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:45.973318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:45.978947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1384/2777] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:45 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:45.983241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:45.996492 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd131e-7f38-4551-bb6c-1386e123ff38 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.002662 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.003321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.003654 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.003940 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.004629 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.006565 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:46.021686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1394/2778] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:46.026370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:46.038671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175b56a-5d78-4e98-9975-ed22157f18c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.047236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.048013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.048304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.048572 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] PATH_INFO: `/v3/projects/6b606f0db49e4ca48cb42069153f95e3/users/673f0f57e7b34faebde44cca8ee8cdca/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.071713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b606f0db49e4ca48cb42069153f95e3, user_id=673f0f57e7b34faebde44cca8ee8cdca, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.074915 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:46.223724 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1385/2779] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:46 2022] PUT /identity/v3/projects/6b606f0db49e4ca48cb42069153f95e3/users/673f0f57e7b34faebde44cca8ee8cdca/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:46.227897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:46.239408 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02dbd-eb3d-43c8-8e1f-2e0312aff5d1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.249661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:46.302179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.302789 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.303066 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.303372 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.304006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.305785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbac2c9-3a6b-4335-859b-8112fca697c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:46.316652 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1395/2780] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:46.321619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:46.334249 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05dc2-180b-45d0-9178-b6675909fb0d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.338864 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.339558 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.339838 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.340111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] PATH_INFO: `/v3/projects/6b606f0db49e4ca48cb42069153f95e3/users/673f0f57e7b34faebde44cca8ee8cdca/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.342740 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b606f0db49e4ca48cb42069153f95e3, user_id=673f0f57e7b34faebde44cca8ee8cdca, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.345479 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:46.360816 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1386/2781] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:46 2022] PUT /identity/v3/projects/6b606f0db49e4ca48cb42069153f95e3/users/673f0f57e7b34faebde44cca8ee8cdca/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:46.371440 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.371737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.372028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.410535 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] MFA Rules not processed for user `673f0f57e7b34faebde44cca8ee8cdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:46.412057 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:46.499773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1396/2782] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:46.513208 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:46.515872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:46.588973 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e5ee-e373-4586-8f72-68d9faed68b5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.594001 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.594646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.594923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.595229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.605270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.612568 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:46.617889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1387/2783] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:55:46.882154 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:46.884094 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:46.902360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bc95-1a31-432f-9678-f0bf6da7e017 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:46.906762 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:46.907541 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:46.907737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:46.908151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:46.995458 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:46.997327 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:47.008894 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1397/2784] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:50.224071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:50.225774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:50.326828 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6fb89-28ed-4e3d-ba4a-6ff67a9833f7 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:50.338702 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:50.340876 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:50.341385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:50.341863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:50.345424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:50.384097 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:50.387412 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49a191-520b-467b-9551-2566e71c69a3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:50.409897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1388/2785] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:55.111461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:55.152646 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:55.194195 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749169-d5f0-413d-a307-8e8b77dcf710 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:55.200487 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:55.201816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:55.202158 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:55.204151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] PATH_INFO: `/v3/users/dfc9e8d44a684cac8e26db9992f97537` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:55.204151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc9e8d44a684cac8e26db9992f97537)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:55.205671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:55.421828 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc9e8d44a684cac8e26db9992f97537'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:55.422443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc9e8d44a684cac8e26db9992f97537'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:55.423065 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc9e8d44a684cac8e26db9992f97537'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:55.430602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc9e8d44a684cac8e26db9992f97537'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:55.444119 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc9e8d44a684cac8e26db9992f97537'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:55.548089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1398/2786] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:55 2022] DELETE /identity/v3/users/dfc9e8d44a684cac8e26db9992f97537 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:55.553519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:55.554168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:55.554168 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:55.576302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:55.578021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:55.631056 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:55.650955 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1389/2787] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:55.661400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:55.663120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:55.725551 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae05425-2353-4980-8758-ef9ac7e59a8b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:55.729214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:55.729816 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:55.732008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:55.732008 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:55.740396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:55.741822 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:55.751993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1399/2788] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:55:56.225122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:56.226739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:56.245387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e53c-a8ee-4d51-93af-64f530dbf884 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:56.252766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:56.253631 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:56.254173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:56.254506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] PATH_INFO: `/v3/projects/8fb8eaa7053b4b579beedf30e565812c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:56.259227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb8eaa7053b4b579beedf30e565812c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:56.260701 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:56.385309 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb8eaa7053b4b579beedf30e565812c', 'request_id': 'req-94db770b-8512-4d2e-9488-b647f5cdb262'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.391908 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb8eaa7053b4b579beedf30e565812c', 'request_id': 'req-94db770b-8512-4d2e-9488-b647f5cdb262'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.398113 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb8eaa7053b4b579beedf30e565812c', 'request_id': 'req-94db770b-8512-4d2e-9488-b647f5cdb262'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.465928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] The token cache is being invalidate because project 8fb8eaa7053b4b579beedf30e565812c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:56.466217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.467563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.469372 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1390/2789] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:56 2022] DELETE /identity/v3/projects/8fb8eaa7053b4b579beedf30e565812c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:55:56.474219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:56.488737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4074bd9-9053-4ffe-803f-60409b751b71 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:56.547118 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:56.554174 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:56.554817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:56.555125 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:56.555427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] PATH_INFO: `/v3/users/673f0f57e7b34faebde44cca8ee8cdca` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:56.556671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673f0f57e7b34faebde44cca8ee8cdca)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:56.558716 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:56.829416 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673f0f57e7b34faebde44cca8ee8cdca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.830089 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673f0f57e7b34faebde44cca8ee8cdca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.830697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673f0f57e7b34faebde44cca8ee8cdca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.837724 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673f0f57e7b34faebde44cca8ee8cdca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.850697 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d0622643-5f77-4af9-ba2e-970431907e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673f0f57e7b34faebde44cca8ee8cdca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:56.938382 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1400/2790] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:55:56 2022] DELETE /identity/v3/users/673f0f57e7b34faebde44cca8ee8cdca => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:57.394067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:57.395673 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:57.415951 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db770b-8512-4d2e-9488-b647f5cdb262 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:57.484070 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:57.484707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:57.484990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:57.485272 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] PATH_INFO: `/v3/projects/6b606f0db49e4ca48cb42069153f95e3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:57.486714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b606f0db49e4ca48cb42069153f95e3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:57.488587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:57.602991 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b606f0db49e4ca48cb42069153f95e3', 'request_id': 'req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:57.610387 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b606f0db49e4ca48cb42069153f95e3', 'request_id': 'req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:57.619101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b606f0db49e4ca48cb42069153f95e3', 'request_id': 'req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:57.742520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] The token cache is being invalidate because project 6b606f0db49e4ca48cb42069153f95e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:55:57.742747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:57.743369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8be3acc-e0b1-4f41-8434-46bf94ef02b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:55:57.745005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1391/2791] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:55:57 2022] DELETE /identity/v3/projects/6b606f0db49e4ca48cb42069153f95e3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:57.750055 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a811f-fe29-4935-a160-cd034c72528e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:57.750595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a811f-fe29-4935-a160-cd034c72528e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:57.750595 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a811f-fe29-4935-a160-cd034c72528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:57.771489 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-888a811f-fe29-4935-a160-cd034c72528e None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:57.772777 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-888a811f-fe29-4935-a160-cd034c72528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:57.836312 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1401/2792] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:57.903496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:57.906295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:57.906295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:57.914671 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:57.926488 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:57.927780 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:57.938370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1392/2793] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:55:57.943510 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a811f-fe29-4935-a160-cd034c72528e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:57.954635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a811f-fe29-4935-a160-cd034c72528e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:57.962753 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:57.963686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:57.963965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:57.964641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:57.965316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:55:57.965625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:57.967452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:57.981328 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1402/2794] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:55:57.986014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:57.996726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ff857-0347-429f-a93e-572cdfb445aa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.002504 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.003282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.003855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.004053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.004754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.007464 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.132576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1393/2795] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:57 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:58.137069 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.148301 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a0e6f-bc7b-4a0d-8884-d56809442fb5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.209900 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.210531 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.210809 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.211108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.211805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.213723 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.223792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:58.315137 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1403/2796] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:58 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:58.320020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.332797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca373834-9e64-4320-bdfc-e4f1e529e7a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.337528 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.338150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.338423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.338692 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.339375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.341022 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.352914 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1394/2797] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:58.358491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.368978 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119881de-8548-47af-92eb-915cb1de7c4e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.374818 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.375600 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.376126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.376631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.377446 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.379754 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87b62-93c3-40c0-b596-95f56e15e598 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.392860 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1404/2798] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:58.396962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.407407 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069628d-a8a3-4fdf-97a3-17e29c50815f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.412554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.413275 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.413553 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.413823 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] PATH_INFO: `/v3/projects/eff20cd772434619a6bbf470253bb418/users/4d6620d6539144cfa83a54ba3853e958/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.430210 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff20cd772434619a6bbf470253bb418, user_id=4d6620d6539144cfa83a54ba3853e958, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.433172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.501403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1395/2799] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:58 2022] PUT /identity/v3/projects/eff20cd772434619a6bbf470253bb418/users/4d6620d6539144cfa83a54ba3853e958/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:58.512016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.512507 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.512885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.546197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] MFA Rules not processed for user `4d6620d6539144cfa83a54ba3853e958`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:58.547540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:58.663188 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1405/2800] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:58.665258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.740911 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81097210-ade0-4566-b652-8f27b1aa250c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.745863 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.746453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.746730 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.747005 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.747729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.750098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:58.876550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1396/2801] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:58 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:55:58.880676 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:58.892501 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cae9b-7483-4611-a417-13062e10a5e7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:58.955937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:58.956563 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:58.956844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:58.957144 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:58.957785 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:58.959824 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.074950 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1406/2802] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:58 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:59.081019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.093610 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ca9a-7fc7-4fe1-95b2-1ab0528d0298 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.099066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.099721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.099999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.100274 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.100926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.102539 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.114857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1397/2803] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:59.125862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.136885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3703a4-9af2-484f-87e4-970d0b190cbc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.142131 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.142739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.143050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.143348 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.144004 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.145599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7d6d-457c-48a4-a127-18872fc6fa3b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.157082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1407/2804] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:55:59.161643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.172312 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827c94-50d4-44c0-a5c4-f9c34a7680d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.177058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.177738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.178013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.178288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] PATH_INFO: `/v3/projects/fddfef5a033046cb9e615c08e1cc45c9/users/655bf9bb7d994b29b068e01c6d89cd27/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.196295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddfef5a033046cb9e615c08e1cc45c9, user_id=655bf9bb7d994b29b068e01c6d89cd27, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.202920 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.287143 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1398/2805] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:59 2022] PUT /identity/v3/projects/fddfef5a033046cb9e615c08e1cc45c9/users/655bf9bb7d994b29b068e01c6d89cd27/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:59.305915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.306379 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.306690 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.340903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] MFA Rules not processed for user `655bf9bb7d994b29b068e01c6d89cd27`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:55:59.343914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:55:59.383360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:59.414023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1408/2806] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:55:59.418638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.477938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:59.491931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213362-14dd-4c68-88e6-f1c7b1c87399 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.499416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.500385 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.500857 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.501332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.502402 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.505811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.605147 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1399/2807] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:55:59 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:59.609616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.621321 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4265-c12d-4191-afe9-24e63e011244 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.681433 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.681961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.682242 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.682522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.683191 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.685770 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.798284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1409/2808] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:55:59 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:55:59.802516 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.813881 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ae9b3-990e-4a75-b797-ee69e91871cc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.818648 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.819292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.819576 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.819855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.820492 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.822227 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.833698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1400/2809] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:55:59.837964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:55:59.848336 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d928-bfd1-4f2c-be18-6366c7a7fbd4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:55:59.853093 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:55:59.853739 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:55:59.854019 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:55:59.854316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] PATH_INFO: `/v3/projects/9938617efff3419ca717e0b6517930c8/users/af550438450047079d730d4aac088952/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:55:59.869948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9938617efff3419ca717e0b6517930c8, user_id=af550438450047079d730d4aac088952, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:55:59.873503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:55:59.994882 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1410/2810] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:55:59 2022] PUT /identity/v3/projects/9938617efff3419ca717e0b6517930c8/users/af550438450047079d730d4aac088952/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:55:59.999650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:00.011038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c17b6-cc2a-4a62-a26b-d7bfae94fbeb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:00.071743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:00.072357 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:00.072635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:00.072912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:00.073544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:00.075155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b3bbe-565e-497c-9c86-71a9f287b8e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:00.085186 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1401/2811] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:56:00.089414 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:00.100310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea270-4ea8-4247-a7ec-0e80d1213ce9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:00.105100 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:00.105758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:00.106040 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:00.106343 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] PATH_INFO: `/v3/projects/9938617efff3419ca717e0b6517930c8/users/af550438450047079d730d4aac088952/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:00.108878 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9938617efff3419ca717e0b6517930c8, user_id=af550438450047079d730d4aac088952, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:00.111718 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:00.122413 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1411/2812] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:00 2022] PUT /identity/v3/projects/9938617efff3419ca717e0b6517930c8/users/af550438450047079d730d4aac088952/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:00.135136 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:00.135426 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:00.135704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:00.166182 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] MFA Rules not processed for user `af550438450047079d730d4aac088952`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:00.167458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:00.244100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1402/2813] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:00.255949 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:00.257702 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:00.323936 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326601-1bda-4638-bda3-1d9ceff24338 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:00.328106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:00.328738 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:00.329022 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:00.329316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:00.381235 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:00.402024 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:00.403549 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:00.415613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1412/2814] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:02.500752 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:02.510963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afba93-845e-4c3b-9c5e-1f733e96bd39 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:02.516076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:02.516715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:02.516995 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:02.517264 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:02.565683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:02.579599 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:02.581072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:02.591051 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1403/2815] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:04.203051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:04.212211 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abe09-2584-4c11-87dc-29c90cf95a8f service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:04.216104 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:04.226973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:04.226973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:04.226973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:04.228209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:04.229696 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be39da0-8dfb-43cf-a79c-8f93adb42cec service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:04.241083 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1413/2816] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:09.176792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:09.265738 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706cff-5b9e-4a3a-a907-9462b13fcbc2 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:09.270650 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:09.271307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:09.271592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:09.271969 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] PATH_INFO: `/v3/users/4d6620d6539144cfa83a54ba3853e958` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:09.273082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6620d6539144cfa83a54ba3853e958)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:09.275111 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:09.614629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6620d6539144cfa83a54ba3853e958'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:09.615325 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6620d6539144cfa83a54ba3853e958'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:09.615959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6620d6539144cfa83a54ba3853e958'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:09.623295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6620d6539144cfa83a54ba3853e958'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:09.728764 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6620d6539144cfa83a54ba3853e958'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:09.748071 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1404/2817] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:09 2022] DELETE /identity/v3/users/4d6620d6539144cfa83a54ba3853e958 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:09.753452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:09.753984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:09.753984 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:09.774854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:09.776285 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:09.844232 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1414/2818] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:09.854414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:09.862023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:09.924112 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d913a1-6c3f-4b0c-b7bd-7d79aadc7253 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:09.927964 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:09.928595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:09.928885 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:09.929173 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:09.940433 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:09.944788 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:09.953292 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1405/2819] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:10.412647 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:10.414424 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:10.427313 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e014eb-6b42-4ea9-8577-a61058a8e571 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:10.442078 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:10.442767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:10.443054 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:10.443362 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] PATH_INFO: `/v3/projects/eff20cd772434619a6bbf470253bb418` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:10.445099 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff20cd772434619a6bbf470253bb418)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:10.447396 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:10.611540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff20cd772434619a6bbf470253bb418', 'request_id': 'req-20ba320a-44ae-45a8-98bf-d99406e9b545'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:10.617523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff20cd772434619a6bbf470253bb418', 'request_id': 'req-20ba320a-44ae-45a8-98bf-d99406e9b545'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:10.694170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff20cd772434619a6bbf470253bb418', 'request_id': 'req-20ba320a-44ae-45a8-98bf-d99406e9b545'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:10.708303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] The token cache is being invalidate because project eff20cd772434619a6bbf470253bb418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:10.711395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:10.711395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:10.711395 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1415/2820] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:10 2022] DELETE /identity/v3/projects/eff20cd772434619a6bbf470253bb418 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:10.714794 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:10.724931 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3a1b-e233-438f-ae0b-01b8285d4177 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:10.728445 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:10.784069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:10.784766 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:10.785268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:10.785665 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] PATH_INFO: `/v3/users/655bf9bb7d994b29b068e01c6d89cd27` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:10.787527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=655bf9bb7d994b29b068e01c6d89cd27)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:10.789589 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:11.030714 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655bf9bb7d994b29b068e01c6d89cd27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.031458 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655bf9bb7d994b29b068e01c6d89cd27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.032072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655bf9bb7d994b29b068e01c6d89cd27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.040202 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655bf9bb7d994b29b068e01c6d89cd27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.145926 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655bf9bb7d994b29b068e01c6d89cd27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.169034 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1406/2821] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:10 2022] DELETE /identity/v3/users/655bf9bb7d994b29b068e01c6d89cd27 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:11.699404 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:11.700884 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:11.720873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba320a-44ae-45a8-98bf-d99406e9b545 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:11.775509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:11.783972 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:11.784626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:11.784906 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:11.785180 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] PATH_INFO: `/v3/projects/fddfef5a033046cb9e615c08e1cc45c9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:11.786663 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddfef5a033046cb9e615c08e1cc45c9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:11.788634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:11.922836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddfef5a033046cb9e615c08e1cc45c9', 'request_id': 'req-95df8878-a956-4aba-8076-b11877673d50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:11.929552 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddfef5a033046cb9e615c08e1cc45c9', 'request_id': 'req-95df8878-a956-4aba-8076-b11877673d50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.042773 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddfef5a033046cb9e615c08e1cc45c9', 'request_id': 'req-95df8878-a956-4aba-8076-b11877673d50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.055694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] The token cache is being invalidate because project fddfef5a033046cb9e615c08e1cc45c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:12.059236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.059236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.059236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1416/2822] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:11 2022] DELETE /identity/v3/projects/fddfef5a033046cb9e615c08e1cc45c9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:12.062297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:12.063796 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:12.077672 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ad10-8fdd-4efa-a8b0-12d386545dce admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:12.155511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:12.156694 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:12.157155 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:12.157659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] PATH_INFO: `/v3/users/af550438450047079d730d4aac088952` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:12.159713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af550438450047079d730d4aac088952)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:12.163934 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:12.321844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:12.465731 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af550438450047079d730d4aac088952'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.466403 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af550438450047079d730d4aac088952'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.467027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af550438450047079d730d4aac088952'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.474894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af550438450047079d730d4aac088952'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.548176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af550438450047079d730d4aac088952'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:12.572810 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1407/2823] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:12 2022] DELETE /identity/v3/users/af550438450047079d730d4aac088952 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:12.753631 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:12.755561 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:12.773610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df8878-a956-4aba-8076-b11877673d50 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:12.891464 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:12.892587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:12.893105 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:12.893589 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] PATH_INFO: `/v3/users/d756846bf9fd408fa2363e046c816f8a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:12.895862 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d756846bf9fd408fa2363e046c816f8a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:12.899781 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:13.119341 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd756846bf9fd408fa2363e046c816f8a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.120029 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd756846bf9fd408fa2363e046c816f8a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.120634 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd756846bf9fd408fa2363e046c816f8a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.127370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:13.129423 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:13.137831 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd756846bf9fd408fa2363e046c816f8a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.159974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60297-7649-496e-8496-588f922520f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:13.162817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-273c5461-ff3d-42a4-9021-a35892682d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd756846bf9fd408fa2363e046c816f8a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.166291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:13.167811 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:13.168122 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:13.168397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] PATH_INFO: `/v3/projects/9938617efff3419ca717e0b6517930c8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:13.170959 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9938617efff3419ca717e0b6517930c8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:13.173366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:13.268667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1417/2824] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:12 2022] DELETE /identity/v3/users/d756846bf9fd408fa2363e046c816f8a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:13.273265 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:13.273556 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:13.273841 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:13.282177 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:13.296329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:13.297687 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:13.311897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9938617efff3419ca717e0b6517930c8', 'request_id': 'req-c372f81f-3fbc-4b42-a74a-35d09453ebdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.319770 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9938617efff3419ca717e0b6517930c8', 'request_id': 'req-c372f81f-3fbc-4b42-a74a-35d09453ebdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.328009 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9938617efff3419ca717e0b6517930c8', 'request_id': 'req-c372f81f-3fbc-4b42-a74a-35d09453ebdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.364993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1418/2825] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:56:13.378187 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:13.379795 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:13.411968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] The token cache is being invalidate because project 9938617efff3419ca717e0b6517930c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:13.412919 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.413762 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:13.415817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1408/2826] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:13 2022] DELETE /identity/v3/projects/9938617efff3419ca717e0b6517930c8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:13.459499 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf981d-ea50-4e1a-b311-fcf5010b83b0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:13.465784 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:13.466511 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:13.466915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:13.468227 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:13.470893 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:13.489953 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:13.491843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:13.505291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1419/2827] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:56:14.074667 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:14.076512 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:14.098594 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372f81f-3fbc-4b42-a74a-35d09453ebdf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:14.106716 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:14.107744 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:14.109037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:14.109451 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] PATH_INFO: `/v3/projects/040839342b484dd28c0b9e7fc248b56e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:14.111338 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] RBAC: Authorizing `identity:delete_project(project_id=040839342b484dd28c0b9e7fc248b56e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:14.113878 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:14.248153 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040839342b484dd28c0b9e7fc248b56e', 'request_id': 'req-0bca09c1-10f5-40e0-84c3-155c0f9a676d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.255397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040839342b484dd28c0b9e7fc248b56e', 'request_id': 'req-0bca09c1-10f5-40e0-84c3-155c0f9a676d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.263183 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040839342b484dd28c0b9e7fc248b56e', 'request_id': 'req-0bca09c1-10f5-40e0-84c3-155c0f9a676d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.357302 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] The token cache is being invalidate because project 040839342b484dd28c0b9e7fc248b56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:14.357570 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.358950 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.360758 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1409/2828] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:14 2022] DELETE /identity/v3/projects/040839342b484dd28c0b9e7fc248b56e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:14.365296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:14.376901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a07bd-ab99-40c2-804a-c4529c97355b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:14.445518 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:14.446141 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:14.446431 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:14.446706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] PATH_INFO: `/v3/users/17b33d36c15a415ebd8f759ad455917a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:14.447959 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b33d36c15a415ebd8f759ad455917a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:14.449958 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:14.725339 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b33d36c15a415ebd8f759ad455917a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.729832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b33d36c15a415ebd8f759ad455917a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.729832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b33d36c15a415ebd8f759ad455917a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.729832 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:14.734673 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b33d36c15a415ebd8f759ad455917a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.752082 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0326d8a-b36d-45c6-989f-ef69589fa48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b33d36c15a415ebd8f759ad455917a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:14.886993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1420/2829] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:14 2022] DELETE /identity/v3/users/17b33d36c15a415ebd8f759ad455917a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:15.359405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:15.362053 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:15.375189 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca09c1-10f5-40e0-84c3-155c0f9a676d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:15.384029 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:15.443698 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:15.444356 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:15.444632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:15.444901 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] PATH_INFO: `/v3/projects/0667faf872364b8fa266fdc880bf0a67` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:15.446085 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0667faf872364b8fa266fdc880bf0a67)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:15.448040 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:15.581021 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0667faf872364b8fa266fdc880bf0a67', 'request_id': 'req-6681ad6e-4612-4c53-9a9b-513516ecaeb1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:15.586683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0667faf872364b8fa266fdc880bf0a67', 'request_id': 'req-6681ad6e-4612-4c53-9a9b-513516ecaeb1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:15.595318 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0667faf872364b8fa266fdc880bf0a67', 'request_id': 'req-6681ad6e-4612-4c53-9a9b-513516ecaeb1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:15.708812 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] The token cache is being invalidate because project 0667faf872364b8fa266fdc880bf0a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:15.709045 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:15.709660 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6681ad6e-4612-4c53-9a9b-513516ecaeb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:15.711232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1410/2830] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:15 2022] DELETE /identity/v3/projects/0667faf872364b8fa266fdc880bf0a67 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:15.716442 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:15.717804 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:15.718197 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:15.741147 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:15.742391 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:15.806205 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1421/2831] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:15.815519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:15.815801 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:15.816083 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:15.839175 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:15.840421 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:15.849446 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1411/2832] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:15.853880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:15.865171 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8c63-7ffe-479c-92d5-98f3767aa96b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:15.870338 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:15.870969 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:15.871284 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:15.871562 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:15.872233 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:56:15.872542 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:15.874427 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:15.887193 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1422/2833] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:56:15.892845 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:15.904026 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c7628-27c7-4859-8503-bc7ec0a1e8f9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:15.911024 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:15.911709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:15.911993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:15.912269 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:15.913014 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:15.914829 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.058633 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1412/2834] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:16.063656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.074216 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffdf6-4470-4a78-8c2f-7ff4ee2af6b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.136695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.137324 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.137607 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.137880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.138521 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.141293 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.229027 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1423/2835] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:16 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:56:16.233514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.244697 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dcf3-b0e1-440e-adf6-e8f34923c958 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.249519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.253746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.253746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.253746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.253746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.253746 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.263821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1413/2836] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:16.268653 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.279047 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979160-cc38-4d94-9bfb-611e7583b66d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.284792 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.285412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.285694 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.286214 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.286866 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.288519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce854c-143a-4ff8-b114-832b3687e8cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.300249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1424/2837] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:16.304805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.323638 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26f441-68a4-4f91-9862-95b78387686e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.330209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.330993 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.331355 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.331677 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] PATH_INFO: `/v3/projects/a6b1722ee51f4789a1a41725bca49ee2/users/9f98cb9038c54e7ab1648b7dc3738ecc/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.349935 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b1722ee51f4789a1a41725bca49ee2, user_id=9f98cb9038c54e7ab1648b7dc3738ecc, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.352711 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.438414 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1414/2838] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:16 2022] PUT /identity/v3/projects/a6b1722ee51f4789a1a41725bca49ee2/users/9f98cb9038c54e7ab1648b7dc3738ecc/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:16.449320 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6195-abb4-420c-b371-98916362eae7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.449616 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6195-abb4-420c-b371-98916362eae7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.449888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6195-abb4-420c-b371-98916362eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.486037 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-044a6195-abb4-420c-b371-98916362eae7 None None] MFA Rules not processed for user `9f98cb9038c54e7ab1648b7dc3738ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:16.487782 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-044a6195-abb4-420c-b371-98916362eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:16.516139 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:16.570879 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1425/2839] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:16.575776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.625119 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:16.646563 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e052c2c-09f7-4113-8663-b71fc1dbe974 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.651875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.652496 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.652779 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.653057 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.653689 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.656467 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.796425 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1415/2840] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:16 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:16.800737 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6195-abb4-420c-b371-98916362eae7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:16.812767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6195-abb4-420c-b371-98916362eae7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:16.879602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:16.880126 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:16.880403 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:16.880698 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:16.881375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:16.884006 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:16.989889 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1426/2841] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:16 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:56:16.995617 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.007311 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9f04-a368-4019-9220-fda446cb700b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.012482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.014358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.014358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.014358 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.014659 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.016092 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.027743 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1416/2842] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:17.032633 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.043891 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5b7-a551-4c0c-8dcd-80df27726a18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.049260 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.049921 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.050268 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.050555 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] PATH_INFO: `/v3/projects/fc7159330d5441ab8023b0fb116fc717/users/61ec466a9e11435fbb2b46960a51a5b4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.066807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7159330d5441ab8023b0fb116fc717, user_id=61ec466a9e11435fbb2b46960a51a5b4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.069567 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.148679 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1427/2843] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:17 2022] PUT /identity/v3/projects/fc7159330d5441ab8023b0fb116fc717/users/61ec466a9e11435fbb2b46960a51a5b4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:17.152940 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.168627 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0576d-ac7d-4a16-8099-f72e50962532 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.239773 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.240361 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.240643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.240917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.241566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.243197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d91d-dfdf-4ceb-9090-933beca10b2f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.254527 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1417/2844] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:17.262880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.274465 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b967-ab29-44a2-b7d9-82458b3fd190 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.279407 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.280296 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.280593 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.280910 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] PATH_INFO: `/v3/projects/fc7159330d5441ab8023b0fb116fc717/users/61ec466a9e11435fbb2b46960a51a5b4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.282983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7159330d5441ab8023b0fb116fc717, user_id=61ec466a9e11435fbb2b46960a51a5b4, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.285704 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.298475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1428/2845] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:17 2022] PUT /identity/v3/projects/fc7159330d5441ab8023b0fb116fc717/users/61ec466a9e11435fbb2b46960a51a5b4/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:56:17.309004 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.309288 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.309560 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.339861 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] MFA Rules not processed for user `61ec466a9e11435fbb2b46960a51a5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:17.341105 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:17.411261 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1418/2846] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:17.422322 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.424091 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:17.489257 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a25e0c-c434-42c0-bc49-0e1c0969e420 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.493013 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.493621 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.493902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.494176 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.504373 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.505870 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df043b3-b7bb-4ee9-97e9-52156d16d3a0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.516107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1429/2847] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:17.544831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:17.580963 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:17.609405 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88476b31-b53f-42f3-9b93-f7f6d75b9266 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:17.614118 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:17.614748 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.615096 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.615386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] PATH_INFO: `/v3/users/9f98cb9038c54e7ab1648b7dc3738ecc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.616897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f98cb9038c54e7ab1648b7dc3738ecc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:17.619581 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:17.846580 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f98cb9038c54e7ab1648b7dc3738ecc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:17.847266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f98cb9038c54e7ab1648b7dc3738ecc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:17.847866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f98cb9038c54e7ab1648b7dc3738ecc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:17.854948 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f98cb9038c54e7ab1648b7dc3738ecc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:17.916614 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f98cb9038c54e7ab1648b7dc3738ecc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:17.935201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1419/2848] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:17 2022] DELETE /identity/v3/users/9f98cb9038c54e7ab1648b7dc3738ecc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:17.940811 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:17.941334 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:17.941450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:17.973049 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:17.975045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:17.996385 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:18.054132 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1430/2849] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:18.064831 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:18.066289 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:18.161663 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6070-e204-46a8-b6c2-d8a9e4ae3e9a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:18.165398 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:18.166019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:18.166297 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:18.166618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:18.176824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:18.178271 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:18.189086 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1420/2850] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:18.713153 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:18.714641 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:18.728003 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397530fc-0595-4099-9a0a-25242d11e379 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:18.733443 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:18.734222 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:18.734601 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:18.734790 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] PATH_INFO: `/v3/projects/a6b1722ee51f4789a1a41725bca49ee2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:18.736316 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b1722ee51f4789a1a41725bca49ee2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:18.738250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:18.847467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b1722ee51f4789a1a41725bca49ee2', 'request_id': 'req-588d493c-4f40-4cea-8f05-1512af13585e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:18.853023 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b1722ee51f4789a1a41725bca49ee2', 'request_id': 'req-588d493c-4f40-4cea-8f05-1512af13585e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:18.922993 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b1722ee51f4789a1a41725bca49ee2', 'request_id': 'req-588d493c-4f40-4cea-8f05-1512af13585e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:18.935532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] The token cache is being invalidate because project a6b1722ee51f4789a1a41725bca49ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:18.935825 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:18.936503 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:18.938156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1431/2851] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:18 2022] DELETE /identity/v3/projects/a6b1722ee51f4789a1a41725bca49ee2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:18.942551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:18.954238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470164f-a05d-40cf-b847-ed45bf39c61e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:19.008763 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:19.015899 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:19.016531 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:19.020653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:19.020653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] PATH_INFO: `/v3/users/61ec466a9e11435fbb2b46960a51a5b4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:19.020653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ec466a9e11435fbb2b46960a51a5b4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:19.020653 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:19.251497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ec466a9e11435fbb2b46960a51a5b4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:19.252059 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ec466a9e11435fbb2b46960a51a5b4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:19.252680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ec466a9e11435fbb2b46960a51a5b4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:19.259772 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ec466a9e11435fbb2b46960a51a5b4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:19.330777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06f647aa-5bd3-4657-b2ee-fbcd28e09124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ec466a9e11435fbb2b46960a51a5b4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:19.350336 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1421/2852] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:18 2022] DELETE /identity/v3/users/61ec466a9e11435fbb2b46960a51a5b4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:19.829935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:19.831659 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:19.848375 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d493c-4f40-4cea-8f05-1512af13585e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:19.917640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:19.918381 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:19.918767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:19.919194 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] PATH_INFO: `/v3/projects/fc7159330d5441ab8023b0fb116fc717` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:19.921034 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7159330d5441ab8023b0fb116fc717)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:19.923048 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.071617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:20.075544 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7159330d5441ab8023b0fb116fc717', 'request_id': 'req-087528d6-e333-4e66-8962-6fda6baaa1c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:20.081537 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7159330d5441ab8023b0fb116fc717', 'request_id': 'req-087528d6-e333-4e66-8962-6fda6baaa1c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:20.165452 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7159330d5441ab8023b0fb116fc717', 'request_id': 'req-087528d6-e333-4e66-8962-6fda6baaa1c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:20.180461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] The token cache is being invalidate because project fc7159330d5441ab8023b0fb116fc717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:20.180461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:20.180461 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-087528d6-e333-4e66-8962-6fda6baaa1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:20.182254 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1432/2853] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:19 2022] DELETE /identity/v3/projects/fc7159330d5441ab8023b0fb116fc717 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:20.187198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.187785 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.187894 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.208116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:20.209399 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:20.273713 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1422/2854] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:20.283421 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.283800 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.284079 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.304942 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:20.306204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:20.314456 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1433/2855] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:20.318834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.329101 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9e988-35d7-4e89-a14b-3c3aab45b6e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.333643 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.334248 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.334522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.334790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.335491 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:56:20.335792 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.337497 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.350238 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1423/2856] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:56:20.354747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.364771 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca3a4-9691-488d-9ddf-28a923c66733 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.369602 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.370198 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.370475 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.370747 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.371401 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.373323 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.502244 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1434/2857] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:20 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:20.506936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.519641 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad35f8-287e-4cfd-991b-dc6421d57f25 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.580298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.580834 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.581116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.581397 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.582023 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.584506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.595554 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:20.714803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1424/2858] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:20 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:20.719920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.730807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964616e-2d01-4b19-bef0-9133e36aa711 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.736994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.737636 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.737919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.738209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.738843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.740523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.751450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1435/2859] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:56:20.755604 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.766662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4421-510e-4eb0-8cdb-6616c869486d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.771500 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.772135 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.772418 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.772768 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.773395 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.775019 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba876a-29b3-4cff-9c83-fca7bf98eeef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.787239 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1425/2860] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:20.791361 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:20.801752 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a303f-19a5-49a3-9fb2-a08cbc5ed88d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:20.806447 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:20.807111 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.807412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.807688 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] PATH_INFO: `/v3/projects/5f563c25fa474496a5a3c3425c9915b1/users/c8fb2002012f473ead381a15f769e103/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.822847 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f563c25fa474496a5a3c3425c9915b1, user_id=c8fb2002012f473ead381a15f769e103, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:20.825557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:20.906530 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1436/2861] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:20 2022] PUT /identity/v3/projects/5f563c25fa474496a5a3c3425c9915b1/users/c8fb2002012f473ead381a15f769e103/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:20.917220 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:20.917555 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:20.917923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:20.958574 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] MFA Rules not processed for user `c8fb2002012f473ead381a15f769e103`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:20.959874 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:21.065228 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1426/2862] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:21.069867 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.139805 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245764a-a337-4631-a1d0-d12fa2e140a6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.146604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.146604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.146604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.146604 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.147278 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.149151 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.249569 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1437/2863] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:21 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:21.254100 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.268805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b75f8-c9d0-4503-baf8-df86463ae700 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.336774 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.337375 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.337655 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.337936 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.338587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.340597 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.456645 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1427/2864] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:21 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:21.459643 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.470672 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88709-9485-47d4-94e7-7c3868f05e06 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.475423 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.476041 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.476315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.476587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.477237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.478837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.492157 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1438/2865] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:56:21.496707 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.508733 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf64-8c90-49ec-baf0-e566c06789c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.513629 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.514453 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.515027 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.518974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] PATH_INFO: `/v3/projects/1e295fd286634b1d85d54b1bc11112a3/users/ba1c0e57f0494550887efe33d8fb4f8a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.533465 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e295fd286634b1d85d54b1bc11112a3, user_id=ba1c0e57f0494550887efe33d8fb4f8a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.537328 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.612152 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1428/2866] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:21 2022] PUT /identity/v3/projects/1e295fd286634b1d85d54b1bc11112a3/users/ba1c0e57f0494550887efe33d8fb4f8a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:21.616438 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.628184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc7db-6f18-4c9d-b6a3-5a751cab35fb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.675269 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:21.692516 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.693133 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.693477 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.693684 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.694330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.695991 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1af2a-3774-4d10-a3b6-7a414fa2c41a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.706903 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1439/2867] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:21.711291 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.722909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d28f-6287-402c-88a8-bef4ac9d1920 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.729158 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.730072 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.730482 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.730855 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] PATH_INFO: `/v3/projects/1e295fd286634b1d85d54b1bc11112a3/users/ba1c0e57f0494550887efe33d8fb4f8a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.733987 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e295fd286634b1d85d54b1bc11112a3, user_id=ba1c0e57f0494550887efe33d8fb4f8a, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:21.737041 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:21.752909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1429/2868] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:21 2022] PUT /identity/v3/projects/1e295fd286634b1d85d54b1bc11112a3/users/ba1c0e57f0494550887efe33d8fb4f8a/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:21.763539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.763797 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.764705 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:21.794439 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] MFA Rules not processed for user `ba1c0e57f0494550887efe33d8fb4f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:21.796196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:21.872287 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1440/2869] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:21.885090 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:21.886817 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:21.919258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:21.959379 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc83787-e299-4592-8bf1-0b5033313a0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:21.963236 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:21.963859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:21.964134 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:21.964404 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:22.028132 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:22.029533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:22.039771 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1430/2870] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:23.835578 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:23.837059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:23.855495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb67c-554b-465c-b753-ecbc35df3e2d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:23.855495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:23.855926 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:23.856028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:23.856236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:23.867756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:23.869252 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330f2b-113e-499c-b9ed-bffdc0bc2f65 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:23.880964 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1441/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:56:28.523550 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:28.625285 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40274a-f6dd-40e4-8d7d-b28f1460c0e5 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:28.630566 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:28.631278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:28.631561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:28.631859 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] PATH_INFO: `/v3/users/c8fb2002012f473ead381a15f769e103` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:28.633081 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fb2002012f473ead381a15f769e103)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:28.635020 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:28.894866 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fb2002012f473ead381a15f769e103'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:28.895618 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fb2002012f473ead381a15f769e103'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:28.896229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fb2002012f473ead381a15f769e103'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:28.903805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fb2002012f473ead381a15f769e103'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.000229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fb2002012f473ead381a15f769e103'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.012790 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:29.020598 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1431/2872] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:28 2022] DELETE /identity/v3/users/c8fb2002012f473ead381a15f769e103 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:29.025310 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:29.025817 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:29.025914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:29.045638 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:29.046854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:29.108594 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1442/2873] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:29.118683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:29.120177 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:29.194760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c8e2-6ae9-4f1a-89cd-6e535d957ba4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:29.198603 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:29.199295 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:29.199575 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:29.199851 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:29.209518 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:29.210976 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:29.221498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1432/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:29.686204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:29.688209 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:29.706494 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23190a7-7b00-4619-8e57-b9479dd26855 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:29.716365 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:29.718585 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:29.719108 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:29.719599 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] PATH_INFO: `/v3/projects/5f563c25fa474496a5a3c3425c9915b1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:29.721658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f563c25fa474496a5a3c3425c9915b1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:29.723706 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:29.875960 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:29.879056 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f563c25fa474496a5a3c3425c9915b1', 'request_id': 'req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.884851 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f563c25fa474496a5a3c3425c9915b1', 'request_id': 'req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.965519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f563c25fa474496a5a3c3425c9915b1', 'request_id': 'req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.979606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] The token cache is being invalidate because project 5f563c25fa474496a5a3c3425c9915b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:29.979819 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.980622 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:29.982202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1443/2875] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:29 2022] DELETE /identity/v3/projects/5f563c25fa474496a5a3c3425c9915b1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:56:29.986634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:29.997204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c8a3-cba0-4b54-b74b-9eb1204c35bb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:30.062266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:30.062923 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:30.063245 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:30.063521 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] PATH_INFO: `/v3/users/ba1c0e57f0494550887efe33d8fb4f8a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:30.064734 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1c0e57f0494550887efe33d8fb4f8a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:30.067209 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:30.259760 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1c0e57f0494550887efe33d8fb4f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:30.260422 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1c0e57f0494550887efe33d8fb4f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:30.261030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1c0e57f0494550887efe33d8fb4f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:30.268961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1c0e57f0494550887efe33d8fb4f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:30.413844 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-93b52dd1-e261-43fa-85e4-089565ce8b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1c0e57f0494550887efe33d8fb4f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:30.439366 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1433/2876] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:29 2022] DELETE /identity/v3/users/ba1c0e57f0494550887efe33d8fb4f8a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:30.900202 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:30.902156 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:30.919961 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1b6b-a9b3-4408-bbcf-469c8ba50cf0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.008667 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.009751 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.010234 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.010727 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] PATH_INFO: `/v3/projects/1e295fd286634b1d85d54b1bc11112a3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.012899 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e295fd286634b1d85d54b1bc11112a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.017420 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.135946 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e295fd286634b1d85d54b1bc11112a3', 'request_id': 'req-43ad9db2-c71e-411b-8e3d-11b6f412a713'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:31.142628 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e295fd286634b1d85d54b1bc11112a3', 'request_id': 'req-43ad9db2-c71e-411b-8e3d-11b6f412a713'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:31.214036 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e295fd286634b1d85d54b1bc11112a3', 'request_id': 'req-43ad9db2-c71e-411b-8e3d-11b6f412a713'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:31.227374 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] The token cache is being invalidate because project 1e295fd286634b1d85d54b1bc11112a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:31.227695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:31.228360 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43ad9db2-c71e-411b-8e3d-11b6f412a713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:31.229896 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1444/2877] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:30 2022] DELETE /identity/v3/projects/1e295fd286634b1d85d54b1bc11112a3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:31.235198 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.235709 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.235808 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.255522 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:31.256729 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:31.269953 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:31.328634 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1434/2878] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:31.398611 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.398813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.399107 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.422077 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:31.423346 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:31.431606 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1445/2879] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:31.436567 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.447347 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506317e-0320-4886-9fa1-172cc58631f6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.452847 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.453680 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.453990 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.454267 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.454928 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:56:31.455277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.456897 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.471150 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1435/2880] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:56:31.476843 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.491389 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde1be0-c363-4757-893a-76c171913c47 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.496160 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.496774 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.497053 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.497326 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.498522 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.500787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.630743 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1446/2881] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:31 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:31.635030 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.645909 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d688-60d0-49bb-b750-374ddb38afc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.705860 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.706380 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.706662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.706938 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.707602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.709623 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.854095 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1436/2882] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:31 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:56:31.858758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.868979 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9609b6-786a-4139-8880-931135f8a9c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.874044 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.874635 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.874987 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.875248 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.875886 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.877467 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.887937 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1447/2883] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:56:31.892204 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.902270 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696992d-1135-448f-a976-e674627dd596 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.907201 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.907804 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.911038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.911038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.911038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.911038 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2400b-469a-4128-9200-1f4832c7b12d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:31.922348 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1437/2884] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:31.926656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:31.938181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a6b7f-8368-4f38-b5dc-42ed8dd35fef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:31.943226 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:31.943914 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:31.944230 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:31.944474 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] PATH_INFO: `/v3/projects/1bb1db7815514a84be6eae81635427b8/users/81e4a185f9f24765a6586ff3d8144820/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:31.960005 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb1db7815514a84be6eae81635427b8, user_id=81e4a185f9f24765a6586ff3d8144820, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:31.962584 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.032766 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:32.037919 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1448/2885] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:31 2022] PUT /identity/v3/projects/1bb1db7815514a84be6eae81635427b8/users/81e4a185f9f24765a6586ff3d8144820/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:32.050683 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.050962 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.051296 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.083712 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] MFA Rules not processed for user `81e4a185f9f24765a6586ff3d8144820`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:32.084944 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:32.158093 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1438/2886] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:56:32.163138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.228196 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bbf23-a768-4039-9a6b-62edb9c38113 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.233626 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.234238 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.234519 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.235279 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.235466 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.237388 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.334858 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1449/2887] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:32 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:32.339232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.351775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081a80-27e4-4f2b-88b5-217381b6a74b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.362799 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:32.411723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.412371 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.412646 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.412917 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.413544 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.415514 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.508394 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1439/2888] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:32 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:32.512657 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.524241 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707985-22c5-41bd-9216-de95fc693d06 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.529074 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.530610 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.530939 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.531249 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.531895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.533587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.545994 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1450/2889] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:32.550419 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.561250 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58274-49a6-4caa-be76-6ca8d08a938c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.565979 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.566682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.566966 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.567278 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] PATH_INFO: `/v3/projects/93150db3b1534f2a8f9289428d88499b/users/3b90ed9136d74d0bae3ffbadb045ddfc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.584389 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93150db3b1534f2a8f9289428d88499b, user_id=3b90ed9136d74d0bae3ffbadb045ddfc, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.587067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.688943 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1440/2890] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:32 2022] PUT /identity/v3/projects/93150db3b1534f2a8f9289428d88499b/users/3b90ed9136d74d0bae3ffbadb045ddfc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:32.693138 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.704491 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce48f2-bbb3-4a27-ac16-8dc987674470 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.763366 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.763854 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.764895 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.765106 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.765686 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.767319 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c8d8-f20f-49d6-9a09-8e5658e32830 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.777291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1451/2891] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:32.782067 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.792611 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2025-ae10-46bb-b36d-2a3cb4fb4b24 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:32.797273 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:32.797921 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.813585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.813585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] PATH_INFO: `/v3/projects/93150db3b1534f2a8f9289428d88499b/users/3b90ed9136d74d0bae3ffbadb045ddfc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.813585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93150db3b1534f2a8f9289428d88499b, user_id=3b90ed9136d74d0bae3ffbadb045ddfc, role_id=16cadafb0e8f49c08c22f1a7c8c1ded6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:32.813585 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:32.814551 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1441/2892] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:32 2022] PUT /identity/v3/projects/93150db3b1534f2a8f9289428d88499b/users/3b90ed9136d74d0bae3ffbadb045ddfc/roles/16cadafb0e8f49c08c22f1a7c8c1ded6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:32.826200 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:32.826540 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:32.827393 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:32.856204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] MFA Rules not processed for user `3b90ed9136d74d0bae3ffbadb045ddfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:32.857410 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:32.920259 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:32.930470 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1452/2893] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:32.942437 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:32.944192 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:33.004676 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf8e3-a68a-45b1-a8e6-ee5de87b5a9e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:33.008439 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:33.009039 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:33.009317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:33.009587 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:33.020010 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:33.021374 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813ef76-66ca-4d8c-9f45-d9c8d809230c service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:33.031747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1442/2894] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:33.104061 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:33.169755 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca90ff-30a7-49f6-88cb-7f1030759bfc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:33.175237 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:33.175880 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:33.176161 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:33.176435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] PATH_INFO: `/v3/users/81e4a185f9f24765a6586ff3d8144820` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:33.177713 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e4a185f9f24765a6586ff3d8144820)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:33.180051 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:33.349007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e4a185f9f24765a6586ff3d8144820'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:33.349661 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e4a185f9f24765a6586ff3d8144820'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:33.350294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e4a185f9f24765a6586ff3d8144820'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:33.357536 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e4a185f9f24765a6586ff3d8144820'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:33.370392 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e4a185f9f24765a6586ff3d8144820'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:33.453965 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1453/2895] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:33 2022] DELETE /identity/v3/users/81e4a185f9f24765a6586ff3d8144820 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:33.458892 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:33.459595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:33.459595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:33.480489 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:33.481978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:33.552507 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1443/2896] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:33.563758 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:33.565350 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:33.633974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c27e-e863-4c5d-ba5a-37fe12c8c009 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:33.637571 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:33.638186 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:33.638484 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:33.638885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:33.649081 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:33.650533 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:33.661682 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1454/2897] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:34.165561 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:34.167213 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:34.180912 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19272e-7451-4f5d-a0ac-b9f8f107aac4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:34.187591 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:34.188263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:34.188547 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:34.189396 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] PATH_INFO: `/v3/projects/1bb1db7815514a84be6eae81635427b8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:34.197197 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb1db7815514a84be6eae81635427b8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:34.199262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:34.202298 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:34.338378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb1db7815514a84be6eae81635427b8', 'request_id': 'req-7bada120-ecf1-4947-9bb5-9776bb5ac790'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.344632 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb1db7815514a84be6eae81635427b8', 'request_id': 'req-7bada120-ecf1-4947-9bb5-9776bb5ac790'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.351754 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb1db7815514a84be6eae81635427b8', 'request_id': 'req-7bada120-ecf1-4947-9bb5-9776bb5ac790'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.459889 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] The token cache is being invalidate because project 1bb1db7815514a84be6eae81635427b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:34.460571 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.460721 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.462370 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1444/2898] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:34 2022] DELETE /identity/v3/projects/1bb1db7815514a84be6eae81635427b8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:34.467885 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:34.478368 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb775-ed35-4b3d-b1a8-5a4191808739 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:34.491236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:34.537695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:34.538337 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:34.538836 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:34.539459 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] PATH_INFO: `/v3/users/3b90ed9136d74d0bae3ffbadb045ddfc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:34.541175 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b90ed9136d74d0bae3ffbadb045ddfc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:34.543239 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:34.758315 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b90ed9136d74d0bae3ffbadb045ddfc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.758974 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b90ed9136d74d0bae3ffbadb045ddfc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.759617 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b90ed9136d74d0bae3ffbadb045ddfc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.768302 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b90ed9136d74d0bae3ffbadb045ddfc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.787181 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65751a69-9cdd-4cbe-b10a-341ba73a19ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b90ed9136d74d0bae3ffbadb045ddfc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:34.856871 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1455/2899] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:34 2022] DELETE /identity/v3/users/3b90ed9136d74d0bae3ffbadb045ddfc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:35.384165 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:35.385670 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:35.399605 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada120-ecf1-4947-9bb5-9776bb5ac790 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:35.465775 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:35.466506 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:35.466777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:35.467052 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] PATH_INFO: `/v3/projects/93150db3b1534f2a8f9289428d88499b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:35.468314 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93150db3b1534f2a8f9289428d88499b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:35.470821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:35.582564 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93150db3b1534f2a8f9289428d88499b', 'request_id': 'req-739e3216-c895-476f-88d1-cd09150de54b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:35.591287 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93150db3b1534f2a8f9289428d88499b', 'request_id': 'req-739e3216-c895-476f-88d1-cd09150de54b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:35.598533 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93150db3b1534f2a8f9289428d88499b', 'request_id': 'req-739e3216-c895-476f-88d1-cd09150de54b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:35.677262 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] The token cache is being invalidate because project 93150db3b1534f2a8f9289428d88499b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:35.677515 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:35.678120 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-739e3216-c895-476f-88d1-cd09150de54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:35.679900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1445/2900] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:35 2022] DELETE /identity/v3/projects/93150db3b1534f2a8f9289428d88499b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:35.685247 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:35.685787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:35.685787 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:35.709088 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:35.710523 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:35.777807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1456/2901] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:56:35.787307 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:35.787595 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:35.787875 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:35.810080 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:35.811378 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:35.819723 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1446/2902] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:35.824295 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:35.835059 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861905-c523-4137-b141-e08dfe802e1b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:35.840167 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:35.840769 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:35.841050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:35.841325 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:35.842026 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:56:35.842329 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:35.844192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:35.857813 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1457/2903] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 17:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:56:35.863033 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:35.872628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625e8bc-3c9d-4fe1-ad51-83d3db984108 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:35.877802 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:35.878429 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:35.878708 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:35.878978 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:35.879662 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:35.881635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:35.898306 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:36.028300 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1447/2904] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 17:56:35 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:36.032916 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.045007 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917686f-7cf5-4dc7-9de1-84e1bc6c94b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.069412 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:36.109915 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.110913 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.111264 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.111539 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.112170 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.114168 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.232143 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1458/2905] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 17:56:36 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:56:36.237369 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.248682 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1e19-9085-40a8-b830-0c2900d2e547 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.254166 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.254797 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.255102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.255400 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.256058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.257726 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.269994 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1448/2906] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:56:36.274116 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.284250 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761340-3337-4e80-8c8d-b7fb0deba975 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.289090 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.289695 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.289963 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.290236 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.290877 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.292505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b7d3-6892-45dd-9dc8-dd1206b88779 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.303666 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1459/2907] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:56:36.308263 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.319013 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a50b-18db-4f66-a6d3-18dd4c1f286e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.323824 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.324517 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.324805 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.325082 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] PATH_INFO: `/v3/projects/8d804ad12d444300918260159b791351/users/16f455f01d3b46bdb98fd28234c582cb/roles/7bafeb1dcbb947f08afdc151d1ed9491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.341214 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d804ad12d444300918260159b791351, user_id=16f455f01d3b46bdb98fd28234c582cb, role_id=7bafeb1dcbb947f08afdc151d1ed9491)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.343903 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.431519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1449/2908] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 17:56:36 2022] PUT /identity/v3/projects/8d804ad12d444300918260159b791351/users/16f455f01d3b46bdb98fd28234c582cb/roles/7bafeb1dcbb947f08afdc151d1ed9491 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:36.442902 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.443225 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.443509 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.475179 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] MFA Rules not processed for user `16f455f01d3b46bdb98fd28234c582cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:36.476426 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:36.547658 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1460/2909] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:36.559064 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.562069 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:36.629891 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82062-bd29-4766-9bdc-592473fa7e1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.633613 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070d1f13e4954e999ae30434d4df6d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.634217 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.634501 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.634776 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.643821 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.650229 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5356-c75d-4bf2-9ebc-9bd810095a4e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.654187 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1450/2910] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:36.674957 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:36.743142 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf002fde-0656-4b58-b036-bff8a08b24c7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:36.747844 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:36.748481 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:36.748759 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:36.749042 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] PATH_INFO: `/v3/users/16f455f01d3b46bdb98fd28234c582cb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:36.750192 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f455f01d3b46bdb98fd28234c582cb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:36.757045 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:36.919183 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:36.929859 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f455f01d3b46bdb98fd28234c582cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:36.930553 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f455f01d3b46bdb98fd28234c582cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:36.931207 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f455f01d3b46bdb98fd28234c582cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:36.940212 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f455f01d3b46bdb98fd28234c582cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:36.953162 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f455f01d3b46bdb98fd28234c582cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:37.056120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1461/2911] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:56:36 2022] DELETE /identity/v3/users/16f455f01d3b46bdb98fd28234c582cb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:37.060968 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:37.061258 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:37.061538 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:37.081511 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] MFA Rules not processed for user `9e6b9970f28a4f428fe5a1ef6b19deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:56:37.082756 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:37.157424 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1451/2912] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 17:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:56:37.168095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:37.169731 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:37.238303 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351fff-1454-469b-a0a0-d36ae3736fa6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:37.242255 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:37.242888 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:37.243204 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:37.243566 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:37.254071 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:37.255645 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:37.266527 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1462/2913] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:56:37.790704 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:56:37.792277 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:56:37.805856 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a55ef-5338-4730-9ed7-f8d3c43de59c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:56:37.811304 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:56:37.811974 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:56:37.812244 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:56:37.812519 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] PATH_INFO: `/v3/projects/8d804ad12d444300918260159b791351` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:56:37.813900 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d804ad12d444300918260159b791351)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:56:37.815925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:56:37.954939 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d804ad12d444300918260159b791351', 'request_id': 'req-15fd9663-0ae4-4719-9c69-d40d6d14054e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:37.960747 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:37.962237 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d804ad12d444300918260159b791351', 'request_id': 'req-15fd9663-0ae4-4719-9c69-d40d6d14054e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:37.969462 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d804ad12d444300918260159b791351', 'request_id': 'req-15fd9663-0ae4-4719-9c69-d40d6d14054e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:38.116536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] The token cache is being invalidate because project 8d804ad12d444300918260159b791351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:56:38.116800 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:38.117386 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:56:38.118895 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1452/2914] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:56:37 2022] DELETE /identity/v3/projects/8d804ad12d444300918260159b791351 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:56:47.261576 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:48.360037 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:36.367807 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:36.377897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06c4a-a662-49c7-a9d6-b35c5406bf20 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:36.429283 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:36.431730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:36.431730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:36.431730 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:36.432411 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:36.494671 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:36.496808 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:36.506441 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1463/2915] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:57:37.448532 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:37.451216 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:37.560036 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd9663-0ae4-4719-9c69-d40d6d14054e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:37.566098 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:37.566739 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:37.567025 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:37.567337 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:37.569416 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:37.589266 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:37.592520 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:37.605340 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1453/2916] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:57:40.109948 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:40.123512 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e00e-74b2-4691-8368-1f7a2aebbdf6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:40.129294 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a58fc0c9a3444a8e5c741204c4dcce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:40.129901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:40.130286 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:40.130570 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:40.133400 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:40.146744 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:40.148445 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:40.161060 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1464/2917] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:57:42.894393 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:42.896116 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:42.909436 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d4fc-74d2-49cf-acd1-d489e2d5c403 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:42.913592 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a500c664114c47a3f856b8eb2b326b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:42.923803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:42.923803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:42.923803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:42.923803 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:42.987525 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:42.988984 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:42.999947 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1454/2918] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:57:47.242270 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:47.244219 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:47.339495 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b17379-e9fa-4513-9f22-025ca7daee95 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:47.346016 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:47.346710 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:47.347025 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:47.347330 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:47.349113 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:47.368262 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:47.371873 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:47.385905 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1465/2919] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:57:51.201628 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:51.203283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:51.217232 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233703c2-592e-4c14-88a7-38d67ffa4947 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:51.222283 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:51.222925 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:51.223268 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:51.223548 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] PATH_INFO: `/v3/users/6d56c325b6d94560bde44328c6690b32` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:51.224695 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d56c325b6d94560bde44328c6690b32)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:51.226619 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:51.437656 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:51.441529 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d56c325b6d94560bde44328c6690b32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.442125 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d56c325b6d94560bde44328c6690b32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.442787 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d56c325b6d94560bde44328c6690b32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.448095 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9afb1-1b9c-4db2-b46f-1c4d17865e3e service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:51.451450 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d56c325b6d94560bde44328c6690b32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.454703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:51.454703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:51.454703 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:51.455000 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:51.456973 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:51.470114 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:51.471756 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:51.481901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1466/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 17:57:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:57:51.523999 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d56c325b6d94560bde44328c6690b32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.533066 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:51.542961 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1455/2921] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:57:51 2022] DELETE /identity/v3/users/6d56c325b6d94560bde44328c6690b32 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:57:51.786273 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:51.787887 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:51.807435 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c10c58-32e1-44e8-a28b-10bce7cb909e service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:51.822344 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:51.871050 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:51.871897 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:51.872178 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:51.872451 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] PATH_INFO: `/v3/projects/c7205972d2d344488c139bc2d5621267` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:51.873613 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7205972d2d344488c139bc2d5621267)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:51.875587 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:51.984837 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7205972d2d344488c139bc2d5621267', 'request_id': 'req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:51.990583 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7205972d2d344488c139bc2d5621267', 'request_id': 'req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.055685 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7205972d2d344488c139bc2d5621267', 'request_id': 'req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.067625 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] The token cache is being invalidate because project c7205972d2d344488c139bc2d5621267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:57:52.071721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.071721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.071721 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1467/2922] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:57:51 2022] DELETE /identity/v3/projects/c7205972d2d344488c139bc2d5621267 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:57:52.075061 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:52.085635 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58badfc7-cff6-43f3-ac22-354582a2ef07 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:52.143242 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:52.143872 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:52.144154 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:52.144427 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] PATH_INFO: `/v3/users/447a046eb95140f6a84a6692c7c96e8f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:52.145565 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=447a046eb95140f6a84a6692c7c96e8f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:52.147510 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:52.336459 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447a046eb95140f6a84a6692c7c96e8f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.337176 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447a046eb95140f6a84a6692c7c96e8f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.337715 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447a046eb95140f6a84a6692c7c96e8f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.346409 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447a046eb95140f6a84a6692c7c96e8f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.427076 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447a046eb95140f6a84a6692c7c96e8f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.446317 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1456/2923] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 17:57:52 2022] DELETE /identity/v3/users/447a046eb95140f6a84a6692c7c96e8f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:57:52.714557 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:57:52.716291 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:57:52.729920 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656fc0a-13ba-4c5c-b52c-5cf21f8e54df admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:57:52.790120 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6b9970f28a4f428fe5a1ef6b19deeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8605dc2974624582acfcd7c33837d42e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:57:52.790767 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:57:52.791935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:57:52.791935 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] PATH_INFO: `/v3/projects/6944fa6d036b44d1bd20180f546f2ed8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:57:52.792505 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6944fa6d036b44d1bd20180f546f2ed8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:57:52.795184 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:57:52.908028 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6944fa6d036b44d1bd20180f546f2ed8', 'request_id': 'req-23561577-d9f2-4eee-9917-90c6b5c7ef68'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.909450 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:52.914901 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6944fa6d036b44d1bd20180f546f2ed8', 'request_id': 'req-23561577-d9f2-4eee-9917-90c6b5c7ef68'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:52.992532 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6944fa6d036b44d1bd20180f546f2ed8', 'request_id': 'req-23561577-d9f2-4eee-9917-90c6b5c7ef68'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:53.005983 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] The token cache is being invalidate because project 6944fa6d036b44d1bd20180f546f2ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:57:53.008085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:53.008085 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23561577-d9f2-4eee-9917-90c6b5c7ef68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:57:53.008640 dv-cinder-835384-24-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1468/2924] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 17:57:52 2022] DELETE /identity/v3/projects/6944fa6d036b44d1bd20180f546f2ed8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:58:02.442602 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:03.063488 dv-cinder-835384-24-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:56.448011 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.449452 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:56.590102 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f359-d9b6-490d-a91f-f5a115efa1cc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.648172 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1b1de8ca7b349ad98880b604d1cb6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a3e6d90af942ef87e7d015c8f32837', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.648777 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.649058 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.649332 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.651256 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:56.662536 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.664151 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581148-2cf4-4833-86dd-d683d37c48e5 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.674498 dv-cinder-835384-24-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1457/2925] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 18:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:03:06.670282 dv-cinder-835384-24-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}